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Introduction 



This Ph.D. thesis is divided in two parts. The first one concerns the equihbrium properties of glassy 
systems, i.e. properties that can be derived from the Gibbs distribution^. Non-glassy equilibrium 
systems are very well understood. Many different thermodynamic phases of classical many-body sys- 
tems are known and their properties can be computed starting from the Gibbs distributions or its 
decomposition in pure states. Quantum effects can be taken into account leading to new thermody- 
namic phases (superfluids, or superconductors) whose statistical properties are also well understood. 
The phase transitions between different phases have been extensively studied in the last century and 
their current understanding is very satisfactory. 

The theoretical understanding of the glass phase and the related glass transition, on the contrary, 
is still poor, even if many important progresses have been recently achieved. Despite the existence of 
a number of mean field models which reproduce the basic phenomenology of glassy systems, and for 
which the glass transition can be fully characterized, the existence of a thermodynamic glass transition 
in finite dimension is still a matter of debate. Many authors believe that the glass transition in finite 
dimension is a purely dynamical phenomenon that cannot be derived from the Gibbs distribution. The 
situation is complicated by the absence of a simple finite dimensional glassy model which could play, 
in the context of glassy systems, the role that the Ising model played in the context of second order 
phase transitions. Experiments and numerical simulations can only investigate the nonequilibrium 
counterpart of the (eventual) thermodynamical glass transition, so experimental data on pure ther- 
modynamical glassy states are not available. Thus, the problem of the existence of a thermodynamic 
glass transition in finite dimension, and many related problems, such as the existence of a diverg- 
ing correlation length, can only be addressed by analytical solution, either exact or approximate, of 
"glassy" models. 

Mean field models are - up to now - the only solvable models of glassy systems: they provide 
an uscfid framework to describe the basic phenomenology observed in experiments. Their detailed 
investigation revealed that the glass transition is connected with the existence of an exponential 
number (in the size of the system) of metastable states. The characterization of these metastable 
states allowed to understand their relevance for the dynamics of the system: it emerged that they 
play a key role in the nonequilibrium dynamics of glasses and are responsible for the existence of a 
nonequilibrium glass transition which closely reflects the one that is observed in real glassy materials. 

Some aspects of the phenomenology of glasses and a theory attempting to describe them are 
presented in chapter 1. As an example of simple model for the glass transition in finite dimension, I 

^The glassy state of matter is often a metastable state, due to the presence of a crystalline state with lower free 
energy. The properties of the "equilibrium" glass can be studied if one assumes that in some way the nucleation of 
the crystal can be avoided. It is not obvious that this is possible, and this point has always been matter of debate. If 
the existence of the crystal can be neglected, one can study the "equilibrium" properties of the glass by restricting the 
Gibbs distribution to the amorphous configurations. 
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studied the Hard Sphere liquid (in collaboration with G. Parisi). This study is presented in chapter 2. 
Obviously the model is not exactly solvable, but it was possible to solve it approximately by means of a 
replica trick and of the HNC approximation - a standard approximation in the theory of simple liquids. 
This strategy was already successfully applied by M. Mezard and G. Parisi to analytic potentials 
(e.g. Lcnnard- Jones), but the application to Hard Spheres required some additional work due to the 
singularity of the interaction potential. In this approximation, a thermodynamic glass transition is 
found. The equation of state of the glass and its pair correlation function g{r) can be computed. This 
allows also to obtain an estimate of the random close packing density and of the mean coordination 
number in the amorphous packings. The results agree well with the available numerical data and 
with other theories. This is encouraging but does not solve the problem of the existence of the glass 
transition in finite dimension because of the approximations involved. 

As discussed above mean field models reproduce many aspects of the phenomenology of glasses. In 
chapter 3 it is shown (in collaboration with G. Parisi and G. Ruocco) that these models also reproduce 
a correlation between the fragility of a liquid - to be defined in chapter 1 - and the vibrational properties 
of its glass that has been recently found by T. Scopigno et al. analyzing experimental data on a wide 
class of glassy materials. This result is - in our opinion - an interesting confirmation of the relevance of 
mean field models in the description of the phenomenology of real glasses. An outcome of this study is 
that the number of metastable states is a decreasing function of fragility; this prediction differs from 
the one that has been obtained by other authors and can be tested, in principle, on real materials. 

The second part of the thesis concerns some recent attempts - discussed in chapter 4 - to build a 
statistical theory of nonequilibrium stationary states induced by the application of an external driving 
force on a thermostatted system. From the chaotic hypothesis, an extension of the ergodic hypothesis 
to nonequilibrium systems proposed by E. G. D. Cohen and G. Gallavotti, an explicit expression for 
the measure describing the system in stationary state can be derived. For time-reversible systems, 
an interesting prediction of this theory is the validity of the fluctuation relation: a relation between 
the probability of positive and negative large fluctuations of the phase space contraction rate cr, often 
identified with the entropy production rate. What is remarkable is that the fluctuation relation is 
universal, in the sense that it contains no model-dependent parameters. 

A test of the fluctuation relation is then a rather stringent test of the theory, and indeed it has 
been performed in a number of cases, in the last decade, with positive result. In chapter 5 (in 
collaboration with A. Giuliani and G. Gallavotti) the fluctuation relation is tested in a numerical 
simulation of a system of particles interacting via a Lcnnard- Jones-like potential and subjected to an 
external driving force and to a thermostatting force (isokinetic constraint). With respect to previous 
studies of similar systems, an important progress has been obtained: the observation of non-Gaussian 
tails in the probability distribution of a. This is important because the fluctuation relation is related 
to the Green-Kubo relations at the Gaussian level, so a test that is really independent from linear 
response theory requires the observation of non-Gaussian tails. This progress was possible thanks to 
the increase of computational power in the last years. 

In chapter 6 some aspects of the driven nonequilibrium dynamics of glassy systems are discussed. 
In the limit of small driving force (small entropy production), it has been shown by L. Cugliandolo 
and J. Kurchan that a nonequilibrium effective temperature can be introduced, which has the property 

of being a temperature in the thermodynamic sense: it controls heat flows and enters the relation 
between spontaneous fluctuations and response to external perturbations as in equilibrium. The 
systems reaches a stationary state and it is possible to decompose the dynamics in different time scales. 
On each time scale, a single effective temperature is defined. The system behaves as if composed by 
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many non-interacting subsystems, evolving on well separated time scales, each one characterized by 
the corresponding effective temperature. 

The fluctuation relation is related to the definition of temperature out of equilibrium. For driven 
systems evolving on a single time scale and in contact with an equilibrated bath at temperature T, the 
temperature of the bath controls the fluctuations of the entropy production rate. Thus, one can ask if, 
for driven glasses, a modified fiuctuation relation can be introduced, in which the effective temperature 
enters instead of the temperature of the bath. This idea was first investigated by M. Sellitto, and many 
proposals in this direction subsequently appeared. I investigated (in collaboration with F. Bonetto, 
L. Cugliandolo and J. Kurchan) a very simple model for glassy dynamics: a Brownian particle in 
contact with a bath whose correlation and response fmiction do not satisfy the fluctuation-dissipation 
relation. An effective temperature can be defined, and we showed that a modified fluctuation relation 
holds, in which the temperature of the bath is replaced by the effective temperature. These results 
are presented in chapter 7 where they are also compared with similar results that recently appeared 
in the literature. Some numerical data, obtained on a sheared Lennard- Jones-like system in the 
glassy regime (in collaboration with L. Angclani and G. Ruocco), arc also presented. They partially 
confirm the results obtained analytically. Unfortunately, a numerical check of all the predictions of the 
model is impossible because the time scales involved are beyond the ones accessible to the numerical 
simulation. 

Chapters 1, 4 and 6 are introductory chapters, while in chapters 2, 3, 5 and 7 original results are 
presented. It is important to remark that this is not a review article. In the introductory chapters, 
I made no attempt to quote all the theories, numerical data, experimental results avalaible on the 
subject. For example, in chapter 1 the inherent structures approach is missing, and in chapter 6 only 
the dynamics of mean field models is discussed, without any attempt to review the rich dynamical 
phenomenology of real materials and the theories attempting to describe it (e.g. Mode-Coupling 
theories). Only the notions that were needed to present the original results have been included in the 
introductory chapters. This does not necessarily mean that I prefer the theories presented in these 
chapters to other ones. 

The results collected here have been published in: 

• Chapter 2: G. Parisi and F. Zamponi, J. Chem. Phys. 123, 144501 (2005). 

• Chapter 3: G. Parisi, G. Ruocco and F. Zamponi, Phys. Rev. E 69, 061505 (2004). 

• Chapter 5: A. Giuliani, F. Zamponi and G. Gallavotti, J. Stat. Phys. 119, 909 (2005). 

• Chapter 7: F. Zamponi, G. Ruocco and L. Angelani, Phys. Rev. E 71, 020101(R) (2005); 

F. Zamponi, F. Bonetto, L. Cugliandolo and J. Kurchan, J. Stat. Mech. (2005) P09013. 
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Chapter 1 

The glass transition 



1.1 Basic phenomenology 

Although Hquids normally crystallize on cooling, there are members of all liquids types (including 
molecular, ionic and metallic) that can be supercooled below the melting temperature Tm and then 
solidify at some temperature Tg, the glass transition temperature. The viscosity ri{T) of the liquid 
increases continuously but very fast below and at some point reaches values so high that the liquid 
does not flow anymore and can be considered a solid for all practical purposes: at low temperatures, 
an amorphous solid phase is observed. The temperature Tg marking the transition between the liquid 
and the glass is often defined by the condition r]{Tg) = 10^^ Poise, but many other definitions are 
possible. 

As an example of this phenomenon, in Fig. 1.1 the viscosity of many glass forming liquids is 
reported as a function of the temperature. Following Angell [1, 2, 3], the quantity log^Q is 
reported as a function of Tg/T. The viscosity increases of about 17 orders of magnitude on decreasing 

the temperature by a factor 2. Note that as the increase of viscosity is so fast, the dependence of Tg 
on the particular value of viscosity (lO^'' Poise) which is chosen to define it is very weak. 

It is often found that the viscosity around Tg follows the Vogel-Fulcher-Tamman (VFT) law [4], 

ri{T) = rjooB^ , (1.1) 

where rjoo, A and Tq are system-dependent parameters. If Tg = this relation reduces to the Arrhenius 
law; otherwise, the extrapolation of the viscosity below Tg leads to a divergence at T = Tq. 



1.1.1 Fragility 

The fragility concept has been introduced by Angell [5] . It describes how fast the viscosity increases 
with decreasing temperature on approaching Tg. "Strong" glasses (low values of fragility) show a 
"weak" T dependence of ri{T), which is often described by the Arrhenius law (see e.g. the curve for 
Si02 in Fig. 1.1), while "fragile" glasses show a much faster T dependence of the relaxation time, often 
described by the VFT law with Tq 0. A common example of fragile glass former is the o-terphenyl 
(OTP), see Fig. 1.1. 

If the VFT law holds, the ratio j, J'j,^ can be taken as a fragility index: it ranges from 1 for strong 
glasses to 10 for the most fragile glasses [2]. However, the common definition of the fragility index. 
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Figure 1.1: (Left, from [3]) Viscosity data for many glass forming liquids. The logarithm of the 
viscosity measured in Poise is reported as a function of Tg/T. The (calorimetric) Tg is defined as the 
temperature at which the enthalpy relaxation time is ~ 200s, and its value is reported in parenthesis 
in the key of the figure. Note that for some systems the value of the calorimetric Tg does not satisfy 
exactly the condition r]{Tg) = 10^^ Poise. Fragility is the slope of the curves in Tg/T = 1. (Right, 
from [6]) Structural relaxation time obtained from dielectric relaxation measurements. The dashed 
line indicates Arrhcnius behavior. The value of Tg, obtained from Ta{Tg) = 100s, and of fragility are 
reported in the key. 



which is also independent of the VFT law, is 

dlogio 

rriA = 



Poise 



d{Tg/T) 



(1.2) 



T=T„ 



i.e. it is given by the slope of the curves in Fig. 1.1 at Tg/T = 1. This definition involves only the 
derivative of the viscosity at Tg, without any assumption on the global behavior of ri{T). According 
to this definition, a strong glass (strictly Arrhcnius behavior) would have rriA ^ 17 (being rjco = 10^^ 
Poise and rj{Tg) = 10^"^ Poise), while the most fragile systems reach tua ~ 160 [2]. If the VFT law 
holds it is easy to show that niA ~ Tg-To ' 

1.1.2 Structural relcixation time 

The viscosity is related to the structural relaxation time Tq, by the Maxwell relation, rj = G^Ta, 
where is the infinite-frequency shear modulus of the liquid. The structural relaxation time is 
related to the decorrelation of density fluctuations. In glass forming liquids, for T^ ^ T > Tg, 
the decorrelation of density fluctuations happens on two well separated time scales: a "fast" time 
scale (^ 10~^^s), which is related to vibrations of the particles around the disordered instantaneous 
positions, and a "slow" time scale Ta , which is related to cooperative rearrangements of the disordered 
structure around which the fast vibrations take place. Through the Maxwell relation, the fast increase 
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of viscosity around Tg is then related to a marked slowing down of the structural dynamics; usually, 
at Tg one has 100s, while in the liquid phase ~ jis. 

The structural relaxation time, obtained from dielectric relaxation data, of some fragile glass 
forming liquids is reported in the right panel of Fig. 1.1. The behavior of Tq(T) is also described 
by a VFT law with an apparent divergence at T = Tq. This leads to the interpretation of Tq as a 
temperature at which a structural arrest takes place. 

A common pictorial interpretation of the dynamics of glass forming liquids above Tg is the following: 
for short times the particles are "caged" by their neighbors and vibrate around a local structure on 
a nanometric scale; the structural relaxation is then interpreted as a slow cooperative rearrangement 
of the cages. Note that on the time scale of the structural relaxation time Tq,, the mean square 
displacement of the particles is smaller than the particle radius, so one cannot think to the structural 
relaxation as a process of single particle "jumps" between adjacent cages. 

1.1.3 Configurational (or excess) entropy 

The idea that the dynamics in the supercooled phase is separated in a fast intra-cage motion and in 

a slow cooperative rearrangement of the structure suggests to split the total entropy of the liquid in a 
"vibrational" contribution, related to the volume of the cages, and a "configurational" contribution, 
that counts the number of different disordered structures that the liquid can assume [7] : 

Suq{T) S^ib{T) + Sc{T) . (1.3) 

To estimate the vibrational contribution to the entropy of the liquid, one can assume that it is roughly 
of the order of the entropy of the corresponding crystal. It is then possible to estimate SciT) as 

S,{T) = Sug{T) - S„yst{T) = ASm - dlogT' [Cu.iT') - C,ryst{T')] , (1.4) 

where ASm = Siiq{Tm) — Scrysi{Tm) is the entropy difference between the liquid and the crystal at the 
melting temperature Tm, and C{T) = is the specific heat. Note that in experiments one usually 
works at constant pressure, C = Cp, while in numerical simulations and in theoretical computations 
one usually works at constant volume, C = Cy. The configurational entropy Sc is sometimes called 
"excess entropy" . 

In Fig. 1.2 the estimate of Sc, obtained from calorimetric measurements of the specific heat and 
using Eq. (1.4), is reported for four different fragile glass formers. Below Tg the liquid falls out of 
equilibrium as the structural relaxation time becomes of the order of the experimental time scale 
(^ 100s). This means that the structural rearrangements are "frozen" on the experimental time 
scale and the only contribution to the specific heat comes from the intra-cage vibrational motion; 
in this situation the specific heat of the liquid becomes of the order of the one of the crystal and 
Sc{T) approaches a constant value. However, one can ask what would happen if the time scale of the 
experiment were much bigger, say lO^s. In this case, the glass transition temperature Tg would be 
lower and the plateau would be reached at smaller values of Sc- If one assumes to be able to perform 
an infinitely slow experiment, one can imagine to follow the extrapolation of the data collected above 
Tg to lower temperatures. For fragile liquids, it is found that a good extrapolation is 

Sc{T) = Soo(l-^^ , (1.5) 

where the parameters 5*00 and Tk are fitted from the data above Tg. This extrapolation is reported 
as a full line in Fig. 1.2. 
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Figure 1.2: (From [6] and references therein) Configurational entropy Sc{T) of four fragile glass 
formers. The black squares are obtained from calorimetric measurements of the specific heat of the 
liquid and of the crystal, see Eq. (1.4). Below Tg (reported in the key) the liquid falls out of equilibrium. 
The black line is the extrapolation according to Eq. (1.5) of the equilibrium data for T > Tg below 
Tg, that goes to zero at T = Tk- The open white circles are derived from the dielectric relaxation 
data of Fig. 1.1 using the Adam-Gibbs relation, Eq. (1.6). The coincidence of the two estimates of 
Sc{T) proves the validity of the Adam-Gibbs relation for Tg >T>Tg. 

The outcome of this procedure is that the configurational entropy seems to vanish at a finite 
temperature Tk- As Sc counts the number of different structures that the liquid can access, it is not 
expected to become negative; also, negative values of Sc imply that the entropy of the liquid becomes 
smaller than the entropy of the crystal, which is a very counterintuitive phenomenon. A possible 
explanation of this paradoxical behavior was proposed by Kauzmann [7], who argued that at some 
temperature between Tg and Tk the free energy barrier for crystal nucleation becomes of the order 
of the free energy barrier between different structures of the liquid. This means that the time scale 
for crystal nucleation becomes of the order of the structural relaxation time Tq, of the liquid, and one 
cannot think anymore to an "equilibrium" liquid as crystallization will occur on the same time scale 
needed to equilibrate the liquid. The extrapolation of Sc{T) down to Tk is then meaningless, and the 
paradox is solved. This argument has been recently reconsidered, see e.g. [8], and its implications 
are still under investigation. 

1.1.4 The ideal glass transition 

Alternatively, one can assume that the existence of the crystal is irrelevant, because crystallization 
can be in some way strongly inhibited: for instance, by considering binary mixtures, or -in numerical 
simulations- by adding a potential term to the Hamiltonian that forbids nucleation. If crystallization is 
neglected, the extrapolation of Sc suggests that at Tk a phase transition happens: at Tk, the number 
of structures available to the liquid is no more exponential, as 5c = 0, and the system is frozen in 
one amorphous structure which can be called an ideal glass. Below Tk, the only contribution to the 
entropy of the ideal glass is the vibrational one, so the specific heat has a jump downward at Tk- The 
transition is expected to be of second order from a thermodynamical point of view. 

An evidence that support this picture is the fact that in almost all the fragile glass formers it is 
found that Tk ~ Tq. For instance, in [2] some 30 cases where Tq = Tk with an error of order 3% 
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Figure 1.3: (Prom [3]) Scaled configurational entropy Sc{Tg)/Sc{T) (obtained from calorimetric data) 
for some of the substances of Fig. 1.2 as a function of Tg/T. The slope of the curves in T = Tg is 
related to the fragility by Eq. (1.7). 

are reported. This means that both the structural relaxation time and the viscosity diverge at Tk, 
so that the structures that are reached at Tk are thermodynamically stable, being associated to an 
infinite structural relaxation time. The exact solution of a class of mean field disordered models which 
share many aspects of the phenomenology with fragile glass formers also supports the picture that a 
thermodynamic transition happens at Tk-, as will be discussed later. 

Of course, the ideal glass transition that occurs in equilibrium is not observable: at some temper- 
ature Tg > Tk where T„(Tg) = Tgxp a real glass transition, freezing the system in a nonequilibrium 
amorphous state (a real glass), happens. The value of Tg, as well as the properties of the nonequilib- 
rium glass (density, structure, etc.) depend on the value of Texp, which is usually ~ 100s as already 
discussed. 



1.1.5 Adam— Gibbs relation 

The identity of Tq and Tk suggests that the divergence of is related to the vanishing of Sc- Indeed, 
Adam and Gibbs [9] proposed that the following relation holds for T close to Tg-. 

""^"^^ = ' ''^^^ = TlogMT)/r^] ' ^'-'^ 

where 5 is a system dependent parameter with the dimension of an energy that is somehow related 
to the energy barrier for activated processes of transition between different liquid structures. A 
similar relation for the viscosity is obtained by the Maxwell relation rj = G^oTa- Eq. (1.6) has been 
successfully tested in a wide number of experiments and numerical simulations. As an example, 
in Fig. 1.2 the configurational entropy obtained from dielectric relaxation measurements of Tq via 
Eq. (1.6) is compared with the calorimetric measurement of Sc- The results show that Eq. (1.6) is 
very well satisfied in a range of temperatures above Tg. 

The original Adam-Gibbs theory leading to Eq. (1.6) was reconsidered and improved in recent 
works [10, 11, 12, 13, 14], which will be discussed later. 
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Eq. (1.6) allows to rewrite the fragility defined by AngcU as 



17 



= 1 



Sc{Tg) dT 



d{TjT) 



(1.7) 



T=Ta 



As Tg^^{Tg) is the specific heat jump at Tg^, the Adam-Gibbs relation implies that fragility is linearly 
related to AC{Tg)/ Sc{Tg). In Fig. 1.3 Sc{Tg)/Sc{T) is reported as a function of Tg/T for many of 
the substances whose viscosity is reported in Fig. 1.1. The close similarity between the two plots is 
another indication of the validity of the Adam-Gibbs relation. 



1.1.6 An order pcirameter for the glciss transition 

To better investigate the possibility that a thermodynamic transition happens at Tk, one should define 
an order parameter to discriminate between the liquid and the (ideal) glass phase [15]. Before going 
to a purely static description of the order parameter, it is easier to discuss a dynamical one. Around 
Tg, the dynamics of the particles happens on two time scales, the fast one related to the intra-cage 
motion, the slow one related to cooperative structural rearrangements. The latter are frozen at Tk- 
at an atomic level, one tends to associate the glass transition with the divergence of the time scale 
on which a given particle can get out of the cage made by its neighbors. While this is an intuitive 
picture, it is not possible to translate it into a good definition of an amorphous solid phase: because 
of the excitation and movements of vacancies and other defects, this individual trapping time scale is 
always finite, although it will increase exponentially when the temperature gets small. What is really 
divergent is the time scale needed for a large scale rearrangement of the structure. This means that, 
even if single particles can always escape their traps in finite time, in the thermodynamic limit density 
fluctuations remain partially correlated also for i — > oo. Considering a system of N particles, a proper 
dynamical definition of the order parameter is, for example, the so-called nonergodicity factor [15, 16] 

fdynik) = lim lim 1 ^(e'i[%W-^.(0)l) = lim lim (pfe(i)p-fe(0))d^„ , (1.8) 

where Xj{t) is the position of particle j at time t, k is an arbitrary wave vector of the order of 
magnitude of the inverse interparticle distance, pk = iV~^/^ J^j e*--^ is a Fourier component of the 
density fluctuations. The thermodynamic limit has to be taken first, because a finite number of 
particles always has a finite relaxation time. The average {•)dyn is on the dynamical history of a 
single system. fdyn{k) is expected to vanish in the liquid phase and to be different from in the glass 
phase. 

In order to construct a static order parameter, one needs to identify a macroscopic quantity that 

discriminates between the different equilibrium states that the system can access. Unfortunately, for 

amorphous states it is impossible to construct such a quantity: in the glass case, in order to choose a 

state, one should first know the average position of each particle in the solid, which requires an infinite 

amount of information. This situation is very different from the one that characterizes an ordered 

solid in which the Fourier components of the density pk develop strong Bragg peaks in the solid phase. 

However, a simple method to deal with amorphous states has been developed in the context of spin 

glasses: the idea is to consider two identical copies of the original system coupled by a small extensive 

attraction of amplitude e. One takes first the thermodynamic limit, and then the limit e ^ 0. In 

the liquid phase, the two copies are able to decorrelate also in the thermodynamic limit, while in the 

^Because the entropy of the hquid shghtly above Tg is S^ii,{Tg) + S'c(Tg) while, slightly below Tg, the structure is 
frozen and the entropy is simply S^n,{Tg). 
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glass phase an infinitesimal attraction is enough to keep the copies close to each other. The order 
parameter is then defined as 

feM = hm lim l^(e^M^,-.J)^ , (l.g) 

e— >0 JV— >oo iV ' 

which is the static analogue of fdyn- The average is now on the equilibrium distribution of the 
two coupled copies. 

It is observed that f{k) jumps discontinuously to a finite value when crossing the glass transition 
temperature Tg. Thus, the glass transition is a second order transition from a thermodynamical point 
of view but it is of first order if one looks to the order parameter. 

1.2 A mean field scenario 

So far, the only systems for which the phenomenology described above could be analytically derived 
are some type of mean field spin glasses [10, 17, 18, 19, 20, 21, 22, 23, 24]: the so-called p-spin 
glasses. These systems show an equilibrium Kauzmann transition at a finite temperature Tk, where 
the configurational entropy vanishes, the specific heat jumps downward and the order parameter 
discontinuously jumps to a finite value. Their dynamics is very similar to the one of glass forming 
liquids in the region of temperature > T ^ Tg, but the VFT behavior of the relaxation time 
is not reproduced by these models: instead, a power law divergence of the relaxation time is found 
at a temperature > Tk- Although this phenomenon is due to the mean field nature of these 
models, it is not completely unrelated to what is observed in glass forming liquids, where a power law 
behavior of is found at temperature T not too close to Tg. Indeed, the equations that describe the 
dynamics of the p-spin glass models are formally very similar to the Mode-Coupling equations [25, 26] 
that describe well the dynamics of supercooled liquids in a range of temperature below Tm but not 
too close to Tg [28]. Moreover, many properties of the free energy landscape of these models (pure 
states, metastable states, barriers, etc.) could be investigated, allowing for a deep understanding of 
the mechanisms leading to the Kauzmann transition and to the slowing down of the dynamics close 
toTrf. 

Excellent reviews on the properties of the p-spin models have been recently published [24, 27, 28]: 
in the following only the main results will be reviewed, referring to [24, 27, 28] and to the original 
papers [10, 17, 18, 19, 20, 21, 22, 23] for all the details. 

1.2.1 Mean field p-spin models: the replica solution and the dynamics 

The model is defined by the Hamiltonian 

^pW = - E -^n.-.V^n---^.. , (1-10) 
ii<---<ip 

where ai are either real variables subject to a spherical constraint af = N, or Ising variables, 
(Tj = ±1, and Jii,...,ij, are independent quenched random Gaussian variables with zero mean and 
variance p\J^/{2NP~^). The sum is over all the ordered p-uples of indices ii < ■ ■ ■ < ip. It is a mean 
field model because each degree of freedom interact with all the others with a strength that vanishes 
in the thermodynamic limit, in order to have an extensive average energy. 

The replica trick [29] allows to solve the model at all temperatures. A thermodynamic transition 
is found at Tk corresponding to a 1-step breaking of the replica symmetry (Irsb). At the transition. 
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the specific heat jumps downward. The order parameter of the transition is the self-overlap between 
two different replicas a and h: 

1 ^ 

1=1 

which plays the role, in the context of spin glass theory, of the nonergodicity factor (1.9). The average 
value of qab jumps from to a finite value qs at Tk- 

The Langevin dynamics of the model can also be solved exactly [28]. A dynamical transition 
is found at a temperature > Tk; the relaxation time of the spin-spin autocorrelation function 
C{t) = shows a power-law divergence for T — > T^. A dynamical order parameter 

can be defined as 

Qd = lim lim 1 V(ai(i)ai(0)) = lim lim C{t) ; (1.12) 

t^oo JV— >oo iV t— >(X) JV— >C!0 
i 

it is the analogue of the dynamical nonergodicity factor defined in (1.8) and jumps to a finite value 
at Trf. Below the system is no more able to equilibrate with the thermal bath and enters a 
nonequilibrium regime. This result gives a strong indication that metastable states, which do not 
appear in the equilibrium calculation, are responsible for the slowing down of the dynamics and for 
the dynamical transition at T^. 

1.2.2 The TAP free energy 

To better understand what is going on in the model one has to investigate the structure of its phase 
space. In particular, one wishes to characterize the equilibrium states in order to understand the nature 

of the thcrmodynamical transition at Tk, as well as the structure of the metastable states which seems 
to trap the system at Td and to be responsible for the existence of a dynamical transition. It turns 
out that a complete characterization of the structure of the states is possible by mean of the TAP free 
energy. 

A general result of statistical mechachics (see e.g. [29, 30]) states that is always possible to 
decompose the equilibrium probability distribution as a sum over pure states^: 

P{(Ti,--- ,(7N) = J2'"<^P"{(ru--- ,(^n) , (1.13) 

a 

where a is an index labelling the states and Wa is the wcnght of each state, ~ '^^^ probability 

distributions of the pure states are characterized by the clustering property, that in mean field reads 

N 

P"(ai,--- ,a^) = n^r(^.) • (1-14) 

i=l 

The single-spin probability distribution is in turn specified by the average magnetization of the spin C7,, 

mf = aP^{a). Thus, a pure state a is completely determined by the set of local magnetizations 

mf , i = 1, • • • ,7V. Moreover, a variational principle exists, stating that the local magnetizations of 

pure states must be minima of some free energy function F(mi). This function, in the context of spin 

glasses, has the name of Thouless- Anderson-Palmer (TAP) free energy [29, 31]. 

The weight Wa of state a is proportional to ex.p[—(3Nfa], where /„ = F{mf)/N. Thus, in the 

thermodynamic limit only the lowest free energy states are relevant. Local minima of F having a free 

energy density / > fmin for — > oo are metastable states. The TAP free energy F{mi) depend, in 

■^In a fully-connected system there is no space notion; thus no boundary conditions can be applied to the system 
and the pure states can be selected only using an external field. 
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tap 



Figure 1.4: (From [27]; Tg corresponds to Tk, T* to T^) Sketch of the evolution in temperature of the 
TAP states for the spherical p-spin model. Each TAP state like (4) can be followed in temperature 
until it becomes unstable and disappears. The complexity vanished continuously at the ground state 
fmin (2) and goes abruptly to above the maximum free energy fmax (3)- (5) is the free energy /* of 
the states that dominate the partition function. (1) is the equilibrium free energy /* — TS(/*) that 
takes into account the entropic contribution of the degeneracy of the states. 



general, explicitly on the temperature, so the whole structure of the states may depend strongly on 
temperature. 

In mean field f)-spin models, the expression of the TAP free energy can be explicitly derived [19, 20] , 

and the distribution of the states can be computed. A peculiar property of the spherical p-spin model, 
which simplify a lot the description of the results of the TAP computation, is that the dependence 
of the free energy functional on T is very simple. Indeed, the states are labeled by their energy E 
at T = 0. The number of states of energy E is Vl{E) = exp NTi{E); the function S(S) is called 
complexity: it is a concave function that vanishes continuously at the ground state energy Efjii^i and 
goes discontinuously to above some value Emax- At finite temperature, the minima get "dressed" 
by thermal fluctuations but they maintain their identity and one can follow their evolution at T > 
0. At some temperature Tmax{E), thermal fluctuations are so large that the states with energy E 
become unstable and disappear, until, at high enough temperature T > Ttap, only the paramagnetic 
minimum, mj = 0, survives. 

At finite temperature, the number of states of given free energy density / is = expA''S(/), 

where = T,{E{f)) and E{f) is the T = energy of the states of free energy /. The function 

!](/) vanishes continuously at / = fmin and drops to zero above / = fmax', a qualitative plot of 
is reported in Fig. 1.5. A similar behavior is found in all p-spins model like the Ising p-spin glass^. 
The main peculiarity of p-spin models is that an exponential number of metastable states is present 
at low enough temperature. 

One can write the partition function Z, at low enough temperature and for N oo, in the 

•^In Ising models as well as in perturbations of the spherical model the picture is complicated by the presence of full 
RSB metastable states [32]. 
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following way: 

where /* e [/mini /max] is such that $(/) = / — TT,{f) is minimum, i.e. it is the solution of 

provided that it belongs to the interval [fmin, fmax]- Starting from high temperature, one encounters 
three temperature regions: 

• For T > T4, the free energy density of the paramagnetic state is smaller than / — TT,{f) for any 
/ € [fmin, fmax], SO the paramagnetic state dominates and coincides with the Gibbs state (in 
this region the decomposition (1.15) is meaningless). 

• For Td>T> Tk, a value /* e [fmin, fmax] is found, such that /* - TT,{f*) is equal to fj,ara- 
This means that the paramagnetic state is obtained from the superposition of an exponential 
numher oi pure states of higher individual free energy density /*. The Gibbs measure is splittcd 
on this exponential number of contributions: however, no phase transition happens at Td because 
of the equality /* — TYj{f*) = fpara which guarantees that the free energy is analytic on 
crossing T^. 

• For T < Tk, the partition function is dominated by the lowest free energy states, /* = fmin, 
with T,{fmin) = and F{T) = fmin - T'E{fmin) = fmin- At Tk a phase transition occurs, cor- 
responding to the 1-step replica symmetry breaking transition found in the replica computation. 

In the range of temperatures Td > T > Tk, the phase space of the model is disconnected in an 
exponentially large number of states, giving a contribution S(T) = E(/*(T)) to the total entropy of 
the system. This means that the entropy S{T) for Td > T > Tk can be written as 

S(T) = S(T) + 5„i6(T) , (1.17) 

Svib{T) being the individual entropy of a state of free energy /*. From the latter relation it turns out 
that the complexity S(T) is the p-spin analogue of the configurational entropy Sc{T) of supercooled 
liquids^ . 

The TAP approach provides also a pictorial explaination of the presence of a dynamical transition 

at Td- If the system is equilibrated at high temperature in the paramagnetic phase, and suddenly 

quenched below Td, the energy density start to decrease toward its equilibrium value. This relaxation 

process can be represented as a descent in the free energy landscape at fixed temperature starting from 

high values of /. What happens is that when the sistcm reaches the value fmax it becomes trapped 

in the highest metastable state and is unable to relax to the equilibrium states of free energy /* , as 

the free energy barriers between different states cannot be crossed in mean field [27, 28]. For this 

reason below Td the systems is unable to equilibrate. What happens in real glasses is that activated 

processes of jump between different metastable states allow the system to relax toward equilibrium 

also below Td- Activated processes give rise to the VFT behavior of the relaxation time, as will be 

discussed in the following. 

''in the interpretation of experimental data one should remember that in experiments S^n, can be estimated only 
by the entropy of the cry stal. However, the vibrational properties of the crystal can be different from the vibrational 
properties of an amorphous glass, see [33] for a review. Corrections due to this fact must be taken into account: in 
many cases, the difference is reduced to a proportionality factor between Sc and S [34]. 
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Figure 1.5: (From [15]) A sketch of the complexity as a function of the free energy density for system 

df - T' 



belonging to the p-spin class. The value f*{m,T), solution of ^ = ^, is also reported. 



1.3 Two methods to compute the complexity 

If a given system presents a structure of the free energy landscape similar to p-spin glasses, two general 
methods to compute the complexity as a function of the free energy of the states without directly 
solving the TAP equations exist; they have been developed in [15, 35, 36, 37, 38, 39, 40, 41]. Both 
methods consider a number of copies of the system coupled by a small field conjugated to the order 
parameter (1.9). 

1.3.1 Real replica method 

The idea of [15, 37] is to consider m copies of the original system, coupled by a small attractive term 
added to the Hamiltonian. The coupling is then switched off after the thermodynamic limit has been 
taken. For T < T^, the small attractive coupling is enough to constrain the m copies to be in the 
same TAP state. At low temperatures, the partition function of the replicated system is then 



where now f*{m,T) is such that $(m, /) = mf — TS(/) is minimum and satisfies the equation 

If m is allowed to assume real vahics by an analytical continuation, the complexity can be computed 
from the knowledge of the function $(m, T) = mf*{m, T) — TE{f*{m, T)). Indeed, it is easy to show 
that 

a$(m,T) 



nrn,T) = 



' (1.20) 



^d[m-^P'l>im,T)] 



S(m,T) = S(r(m,T)) = m'^ ' = mprim,T) - /3$(m,T) . 

The function S(/) can be reconstructed from the parametric plot of f*{m, T) and S(to, T) by varying 
m at fixed temperature. 
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The glass transition happens when /3 equals the slope so{T) of in / = fmin, so Tk is defined 
by Tkso{Tk) = 1. If m < 1, the value of /*(m, T) correspond to a smaller s\o\)e with respect to m = 1, 
so the glass transition is shifted towards lower values of the temperature, see Fig. 1.5. For any value 
of the temperature T below Tk it exists a value m* (T) < 1 such that for m < m* the system is in the 
liquid phase. The free energy for T < Tk and m < m* (T) can be computed by analytic continuation 
of the free energy of the high temperature liquid. As the free energy is always continuous and it is 
independent of m in the glass phase (being simply the value fmin{T) such that ^{fmin) = 0), one can 
compute the free energy of the glass below Tr- simply as Fgiass{T) = fmin{T) = <^{m*{T),T)/m*{T). 

This method allows to compute the complexity as well as the free energy of the glass, i.e. of the 
lowest free energy states, at any temperature, if one is able to compute the free energy of m copies 
of the original system constrained to be in the same free energy state and to perform the analytical 
continuation to real m. In [40] it was applied to the spherical p-spin system and it was shown that 
the method reproduces the results obtained from the explicit TAP computation. 



1.3.2 Potential method 

The second method [35, 36, 38, 39] starts from a reference configuration cr of the original system and 
consider the partition function of an identical system r which Hamiltonian has been corrected by the 
addition of a coupling to the configuration a: 

Z{a, e,T) = J dT e-/3^W+/3^^9(<^.^) , (1.21) 

where q{a,T) = N~^Ylii'^i'''i (l-H)- If t^i^ reference configuration a is extracted from the 

equilibrium distribution at temperature T, the free energy F{a,e,T) = —TN~^ log Z{a, e,T) should 
not depend on the particular choice of cr for A/' —> oo. Thus one averages over the equilibrium 
distribution of a at temperature T and defines 

F{e,T) = --J da-^^logZ{a,e,T) . (1.22) 

If, in the limit e — > 0, the correlation between a and t is lost, one has F{e = 0, T) — F{T). Otherwise, 
one can study the effect of the correlation in the limit of vanishing coupling between the replicas. 
Being interested in the behavior at e = 0, one considers the Legendre transform of F(e, T), 

V{q,T) = max[F{e,T)+eq\ , g(e) = -^^^ = (g(a, r)), . (1.23) 

The thermodynamic potential V{q, T) is the free-energy of the system r constrained to be at a fixed 
overlap q with cr: 



V{q,T) = -- J da log Z {a, q,T) , 
Z{a,q,T) = J dTe-P"^^'>5{q-q{a,T)) . 



(1.24) 



As ^ = e(g), the average value of the order parameter in the limit e — > is the value of q that solves 
^ = 0; the minima of V{q) correspond to the possible phases in the limit of zero coupling. 

The qualitative behavior of V{q, T) — F{T) is shown in Fig. 1.6 for the spherical mean field p-spin 
model: for T > it is a convex function of q with only one minimum at q = 0. At the dynamical 
transition temperature Td a secondary minimum starts to develop at finite q. On lowering the tem- 
perature below Td, the value of V at the minimum decreases and vanishes at the thermodynamical 
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Figure 1.6: The two-replica potential, V{q,T) — F{T), for Te[Tk,Ti-[] in the spherical p-spin model. 

transition temperature Tk- Indeed, for T > Td there is only one phase in which the two copies a 
and T are uncorrelated and the average overlap vanishes. Below T^, a new phase in which the two 
copies are in the same TAP state appears; this phase is metastable because there is an exponential 
number of TAP states so the probability of finding the two copies in the same state is exponentially 
small in absence of coupling. The value of g, qmin{T), corresponding to this secondary minimum is 
the self-overlap of the equilibrium TAP states at temperature T. For T < Tk, the value of V{qmin) 
becomes equal to V{Q), as the number of states is no more exponential and a vanishing coupling 
is enough to constrain the two copies to be in the same state. This correspond to the Irsb phase 
transition. This approach underlines the first order nature of the transition from the point of view of 
the order parameter. 

The value of V{q, T) at the secondary minimum for TCz[Tk, Td], i.e. the average free energy of the 
configuration t at q = qmin = q{T), is the free energy f*(T) of the equilibrium TAP states. From 
Eq. (1.24), recalling that F{T) = f*{T) - ri](/*(r)), one has 

V{qra^n{T),T)~V{0,T) = r{T)-F{T)^TJ:{r{T)) , (1.25) 

where S(/*(T)) is the equilibrium complexity. The vanishing of V{q,nin{TK),TK)~F{TK) corresponds 
to the vanishing of the complexity at Tr- . 

From the potential V{q, T) one can extract the values of the dynamical and thermodynamical 
transitions as well as the free energy of the equilibrium states f*{T) and their complexity S(/*(r)). 
To obtain informations about the metastable TAP states one needs to consider a reference configuration 
equilibrated at a different temperature T': 

Viq,T,T')^-- da log Z {a, q,T) , 

Z{a,q,T) = J dTe-^"'^^^S{q-q{a,T)) . 

If T'E[TK,Td] and if the evolution of the TAP states in temperature is described by the curves in 
Fig. 1.4, the configuration a is in one of the equilibrium TAP states at temperature T', while the 
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configuration t is constrained to be close to it (i.e. in the same TAP state) but at temperature T . 
The free energy of r for q = qmin{T, T') is the free energy of an equilibrium TAP state at temperature 
T' when followed at temperature T. The TAP states are labeled by their zero-temperature energy E; 
their free energy is fTAp{E,T). Thus one has^ 

V{qmin{T, T'),T, T') = fTAp{E{T'),T) , (1.27) 

where E{T') is the T = energy of the equiUbrium TAP states at temperature T' and f*{T') = 
fTAp{E{T'),T'). 

The procedure to compute the properties of all the TAP states using the potential method is the 
following: 

• First one consider the potential for T = T' and computes the free energy f*(T) and the com- 
plexity Y.{f*{T)) for Te[TK,Td]. This give access to the complexity S(/). 

• Then one fixes T'^[TK,Td] and computes, using Eq. (1.27) the free energy fTAp{E{T'),T) as a 
function of T down to T = 0. 

• In particular, the free energy of the glass (i.e. of the lowest TAP states) is obtained considering 

the limit T' ^ Tk (from above) in Eq. (1.27). 

It was shown in [36, 38] that the result is consistent with the direct computation using the TAP 
equations. 



1.3.3 Connection with the standaird repUca method 



It is interesting to consider the relation between the two methods described above and the iRSB free 
energy, also because some of the formulae will be useful in the applications of the next chapters. 

In the spherical p-spin model, the average over the distribution of the couplings J (indicated by 
an overbar) of the n times replicated partition function can be rewritten as [21] 



Z"(J) 



j dQab e 



NfiQ) 



(1.28) 



ah 



where a,b = 1, • • • , n and Qab in the n x n overlap matrix 
for Q (in the example, n = 6 and m = 3): 



Q = 



]. The substitution of the iRSB ansatz 
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in Eq. (1.28) gives, for N 



> 00, 



exp [ - l3nN(j)iRSB {m* ,q*,T)] 



T . „ 



F{T) = -- lim 9„Z" = ^iRSB{m* ,q* ,T) 



(1.29) 



^This equation is slightly different from the one reported in [36] because the equilibrium free energy F(T) has not 
been subtracted in the definition of V{q,T,T'). 



1.3. TWO METHODS TO COMPUTE THE COMPLEXITY 



17 



where the iRSB free energy is 

1 f «2 777 — 1 1 1 

tes(m,(7,T) = -— |^[l + (m-l)(zf] +-^log(l-^) + -log[l + (m-l)(7]| , (1.30) 

and 777*, q* arc sohitions of dm4>iRSB = and dqcfimsB = 0. For T > Tk the sohition q* = 0, m* = 1 
is the stable one, even if a solution with q* ^ appears for T < T^. Below Tk this solution, with 
7^ and m* < 1, is the free energy of the glass. 



Real replica method 

In the real replica method the partition function of m copies of the system is considered. Using the 
replica trick to compute the free energy, 

T-. 



$(m,T) = --\ogZm = lim a„(Z„)- = -- lim , (1.31) 

iV iV ra— >0 iV ra— >0 

one obtains the partition function of nm copies of the system, with the constraint that each block of 
m replicas has to be in the same state. This leads naturally to the iRSB structure for the overlap 
matrix (with m fixed) and 

$(m,T) = lim dnexp[- pnmN(PiRSB{m,q*,T)] = m(j)xRSB{m,q* ,T) . (1.32) 

iV ra— ►O 

Note that the hypothesis that the m. replicas are in the same state implies that for any value of (ttj, T) 
the correct solution is the one with q* ^ 0. Above Tj^ this solution disappears as a vanishing coupling 
cannot constrain the replicas to stay close to each other. 

The free energy of the real replica method is the iRSB free energy as a function of m at the value 
^ that solves dq(j}\RSB = 0. Using Eq. (1.20) the complexity as a function of m is 

TE(to,T) =m29„[m-i$(m,r)] = m^d^(^iRSB{m,q\T) , (1.33) 

and the equilibrium complexity is 



s(T) = s(i,r) = -l 



{q*Y + \og{l -q*) + q* 



(1.34) 



As T,{m,T) cx dm4>iRSB, the value m* that optimizes the iRSB free energy below Tk coincides with 
the value m* defined by E(m*, T) = of the real replica method. 

Potential method 

Using the replica trick [36] the following expression for V{q,T,T') is derived^: 



V(q,T,T') = - lim lim f dae-0'"('')Z(a,q,T)"^-A . (1.35) 



The last integral can be rewritten as 



(/. \ 11 p n rn 

dae-^'"^'^^Z{a,q,Tr-'\ = daaaS-^^^"""^''"'^ Y[l[diq - q{aai,aaa)) , (1-36) 
J J a=\a=2 



^In [36], Eq. (15), the factor n ^ is missing probably due to a misprint. 
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where a = 1, • • • , n, a = 1, • • • , m, and = P'^ia + — ^la)- This is again the expression of 
the nm times repUcated equihbrium partition function, with the additional constraint given by the 
(5-functions. The average over the disorder gives 



/n m 
dQaaw e^^(«) n n -^(^ - 



a=l a=2 

f{Q) = \Y. /3a/3/3QL,./5 
aa, 6/3 

Evaluating the integral at the saddle point, one has 



1 



(1.37) 



■ log det Q . 



V{q,T,T') = - lim lim -^f{Q) ■ 
n— >0m— >i n om 



(1.38) 



The matrix Q is defined by the following conditions: 
i) the elements on the diagonal are equal to 1; 
a) the elements Qaiacn ct > I, are equal to q: 

in) all the other elements are determined by the maximization of f{Q)- 

As usual, one needs a parametrization of the matrix Q in order to perform the analytic continuation 
to non-integer n and m. A possible ansatz is [36] (in the example, n = 2, m = 4): 
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and corresponds to the following structure: each replica of a is independent from the others, and for 
each tJ there arc m — 1 copies of r which have overlap q with u and overlap r within themselves. 
Within this ansatz, and using the relation 
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one gets 
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(1.41) 



where r{q) is determined by 9,-^ = 0. 

For T = T' > Tk it is easy to check that the condition ^ = dqV = 0, together with drV = 0, is 
satisfied ii q = r. Thus, when V{q) is stationary, r{q) = q and the potential V{q) reduces to 



Viq,T) = -^-!^--[logil-q) + q] 



F{T) + lim dm(l>iRSB{m,q,T) . 



(1.42) 



The latter relation can be proven in general and follows from the observation that when ^ = the 
matrix Q reduces to the usual iRSB overlap matrix Q. This is because the condition ^ = dqV = 
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together with drV = is equivalent, from Eq. (1.38), to 

This means that the function f{Q) must be stationary with respect to all the elements of Q, and the 
iRSB matrix Q provides a solution to this condition, li Q = Q, one has 

^=-pcPiRSB{m,q,T) . (1.44) 
nm 

Substituting this expression in Eq. (1.38), one obtains 



V{q,T) = lim drn{m(biRSBim,q,T)) = F{T) + lim d^cj^wsBim, q,T) ; (1.45) 

using the relation (j)iRSB{,Tn = 1) = F{T) that holds above Tk- Therefore, on its stationary points, 
V{q, T) is given (at the iRSB level) by this simple expression, that can be easily calculated in several 
models. Note that, as discussed in [39], full RSB effects can be important for the computation of 

V{q,T) even in Irsb models such as the p-spin spherical model. 

If T' = Tk and T < Tk, the value of V in the secondary minimum can still be computed using 
the simple ansatz (1.39). It can be seen, using the relation 

p/2 

(1.46) 



Tk 



1 + (m* - l)q* 



rrr 

that follows from the equations that define m* and q* , that the solutions to drV = Q, dqV = Q, is 

^^^* ' . (1 47) 

Indeed r is the self-overlap of the replicas inside the equilibrium states at Tk, so it is equal to the 
self-overlap q* of the glass. Substituting these espressions in V{q, T, T') one obtains 

V{qmin,T,TK) = 4>iRSB{m*,q*,T) = Fgiass{T) , (1.48) 

as expected from Eq. (1.27). 



Discussion 

The explicit relation between the free energies ^{m,T) and V{q,T,T') and the Irsb free energy 
(l>iRSB{m,q,T) derived for the spherical j3-spin model confirms that: 

• the real replica potential ^(m,T) is related to the iRSB free energy as a function of m for 
q — q*(m,T) ^ 0. For this reason it allows to study the properties in the glass phase at 
m = m* < 1. Remarkably, it also allows to compute the free energy of the metastable states 
and their complexity for Tg[Tk,Tci]. 

• the potential V{q,T,T') for T = T' is related to the (derivative of the) Irsb free energy at 
m = 1, as a function of q. Thus it is not suitable to study the region below Tk where m ^ 1, 
but it allows to study in detail the properties of the intermediate phase Tg[Tk, T^], in particular 
the metastability of the q phase for Te[Tx,2d] and to estimate the barrier between the 
metastable and stable regions [44, 46]. 

• to compute the free energy of the metastable states and, as a particular case, the free energy of 
the glass, one needs to consider an extended definition of the potential, V{q, T, T'), see Eq. (1.26). 
The relation between this potential and (piRSB is more involved, but at least for T' = Tk one 
has V{qmin,T,TK) = <l>iRSB{m*,q\T) = FgiassiT). 
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1.4 Beyond mean field 

The random first order scenario that emerges from the analytical solution of p-sp'm disordered models 
explains most of the phenomenology of the glass transition. However, some big issues remain unex- 
plained. The main problem of the mean field approach as usual is the existence of metastable states 
with intensive free energy higher than the free energy of the ground states, / > fmin- These states 
are responsible for the existence of a finite complexity. Their lifetime is infinite, so they are able to 
trap the system below T^. This is the reason why the dynamical transition, i.e. the divergence of the 
structural relaxation time, happens at a temperature Td > Tk- 

In a model with short range interactions, metastable states have a finite lifetime due to the nu- 
cleation of bubbles of the stable phase inside the metastable one, so they are not thermodynamically 
stable. One should expect the existence of well defined states with / > fmin to be impossible; but 
the analogy between mean field models and real glasses is mainly based on the analogy between the 
complexity T,{T) and the configurational entropy Sc(T)- How can one explain the existence of a finite 
configurational entropy, related to well defined metastable states, in a short range system? 

Moreover, the observed crossover of the relaxation time from a power-law behavior to a Vogel- 
Fulcher-Tamman law (1.1) as well as the Adam-Gibbs relation (1.6) are not explained by the mean 
field theory, which predicts a strict power-law divergence of for T — > Tj'. The observation of a 
finite relaxation time below Td is again related to the finite lifetime of metastable states. The system, 
instead of being trapped forever into a state, is able to escape, due to nuclcation processes; it is then 
trapped by another state, and so on. These processes of jump between metastable states are activated 
processes: the system has to cross some free energy barrier in order to jump from one state to another. 
The relaxation time is then expected to scale as 

ra(r)~rooexp[/3AF(T)] , (1.49) 

AF{T) being the typical free energy barrier that the system has to c;ross at temperature T. The 
VFT law and the observation that To ^ Tk suggest that the barrier should diverge at Tk, AF{T) ~ 
(T — Tk)~^', more generally, the Adam Gibbs formula relates this divergence to the vanishing of 
the configurational entropy, AF{T) ~ Sc{T)~^. It is then essential to understand what is really the 
meaning of Sc{T) in finite dimension and why it is related to the free energy barrier for nucleation. 

A crucial observation is that the divergence of the relaxation time at Tk, in short range systems, is 
possible only if the cooperative processes of structural rearrangement involve atoms that are correlated 
on a typical length scale ^, which diverges at Tk- If no divergent length scale is present in the system, 
it is always possible to divide it in finite subsystems, each one relaxing independently of the others: 
and the relaxation of a finite system usually happens in finite time, if the interactions are finite and 
have short range. 

A simple idea that follows from the above observation and can explain how the mean field picture 
is modified in short range systems is the following [10, 11, 12, 13, 14, 42, 43, 45, 46, 47]. It exists a 
typical lenght scale i{T) over which structural relaxation processes happens. If one looks at smaller 
length scales, the system behaves as if it were mean field: metastable states are stable for I < ^, 
yielding a finite local complexity. However, for large scales I > ^, metastability is destroyed and only 
the lowest free energy states are stable. For T T^, ^ ^ oo, so below Tk a stable ideal glass phase 
is possible. This idea leads naturally to the identification of the configurational entropy Sc(T) with 
the local complexity S(r), and to a derivation of an Adam-Gibbs-like relation between the relaxation 
time Ta and S(T). 
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1.4.1 Dynamical heterogeneities: a derivation of the Adam-Gibbs relation 

The above considerations can be formalized as follows [14]. An homogeneous equilibrium state in 
a finite dimensional system is defined as the probability distribution that is reached in each finite 
volume inside the container when the thermodynamic limit is taken with a given sequence of boundary 
conditions [30]: e.g. for a ferromagnet at low temperatures the two states + and — can be obtained 
taking the thermodynamic limit with the spins on the boundary fixed to + or — , respectively. 

For glassy systems this simple procedure does not work because the order parameter (1.8) is the 
self-overlap of the configurations of the same system for t ^ oo or, equivalently, the overlap (1.9) 
between two coupled copies of the system, and it is not clear how to fix it using boundary conditions. 

To overcome this problem, assume that an equilibrium state a of free energy density exists. 
Assume also that a whole distribution of states of complexity S(/) (per unit volume) exists for 
./ G [fmin, frnax]- Thcn, considcr a configuration belonging to the state a and a bubble of radius R 
inside the system; all the particles outside the bubble are frozen in their position and act as boundary 
terms, and one consider the partition function of the bubble in presence of these boundary conditions. 
The idea is to find a self-consistency condition for the radius of the bubble R requesting that the 
particles inside the bubble remain in the state a due to the boundary conditions. 

The partition function of the bubble is'' 

Zr ~ e-'^/"^' + ^ e-'^/-^'-'^^^' = e-^f-''" + J^"^^^ df e^if ^i^'-^f^'-^^^' . (1.50) 

77^a fmin 

The first term represents the bubble in the same state a of the particles outside the boundary, while 
the second term represents the situation where the bubble is in a different state. In this case, the term 
(3TR^ represents the free energy cost of the interface between the states a and 7 at the boundary of 
the bubble, which should scale as R,^ with 6 < d—1 if the interactions have short range. If the state a 
is chosen to be an equilibrium state, of energy /„ = /* such that ^(/*) = P, the partition function 
becomes 

Zr ~ e-''/*^' + e^(/*)«'-/3/*«'-/3Tf«' , (1.51) 

where E(/*(T)) = S(T) is the equilibrium complexity as usual. It is clear that if S(/*)i?''-/3Ti?® > 0, 
the second term dominates and the bubble is in a different state, otherwise the first term dominates 
and the boundary conditions are able to keep the particles inside the bubble in the state a. If the 
bubble is in the state a it gains the term due to the interface, f3TR^; however the probability of 
changing state is very large due to the exponential degeneracy of the states, as expressed by the term 
S(r)i?''. In this sense, one can think to AFj.{T) = —TYi{T) as the bulk free energy gain that drives 
the escape from the state a: it is not a free energy difference between the stable and metastable 
phase, as in ordinary nucleation problems, rather it is the contribution coming from the large number 
of possibilities that one has to choose a different state with the same free energy density. 

As ^ < d — 1 in short range systems, it is clear that for i? ^ 00 the second term is always 
dominant and the bubble always escapes from the state a. This implies that the initial assumption 
on the existence of the state a is not consistent as long as S(/) > 0. This is a formalization of the 
statement that an exponential number of states cannot exists in short range systems: in other words, 

^To simplify the equations, in the following 0(1) constants related to the shape of the bubble will be neglected, e.g. 

cue should write ViiR'^ instead of i?'', v^i being the volume of a sphere of radius R = 1, and sgR^ instead of sg 
taking into account the shape of the interface. These constants do not change the qualitative results of this section, and 
will eventually be included later. 
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there are no boundary conditions trough which one can select an exponential number of different 
states. 

However, if R is small enough, one has Y,{f*)R'^ — l3TR^ < and the bubble remains in the state 
a. This happens for 

fl<«r) = (^)'". (1.52) 

The conclusion is that it exists a temperature dependent length scale, ^, such that for R < ^ there is 
an exponential number of stable states. These states are destroyed by relaxation processes that change 
the state inside the bubble if i? > ^. 

The argument can be rephrased as follows: the free energy cost for creating a bubble of radius 
i? of a state j ^ a inside the state a is AF ~ —TY,{T)R''- + T{T)R^. If one is able to create, by a 
fluctuation, a bubble of radius R > ^(T), then the bubble will never go back into the state a and a 
(local) activated process of escaping from a (local) state has taken place. To do that one has to cross 
the barrier given by the maximum of AF{R) in the interval [0,^]. This maximum is at 



d-e 



(1.53) 



and the value of the free energy barrier is 



AF* = AF{R*) = Aid, 9) ^ , Aid,0)=[-] -[-] . (1.54) 



[TE(T)]d^ \d 
Then the relaxation time should scale as 

~ exp[/3AF*] ~ exp ^ /3 ^'^^'^f^^ \ , (1.55) 

which in (i = 3 for 6' = (i— 1 = 2 gives 




r„~exp|/3^^^| . (1.56) 

The latter relation is very similar to the Adam-Gibbs relation (1.6) even if it differs from it in the 

exponents*. 

The function E(r) is interpreted in this way as the local complexity, i.e. the number of different 
states the system can visit on a scale ^(T). The interpretation of — TS(T) as a driving force for 
nucleation leads then to the Adam-Gibbs relation. Prom S(T) ~ T — Tk close to Tr- and assuming 
that T(Tr-) is finite it follows, for ^ = — 1, that 



^(T) ~i?*(r) ~ (T-Tx)" , Ta ~ ec^-^^^)' , (1.57) 

so the correlation length diverges at Tk as expected and a VFT like relation is derived for the relaxation 
time Ta, again with exponent 2. Note that the Adam-Gibbs relation and the VFT law are recovered 
if one assumes that 9 = d/2; an argument in favor of this scaling for the surface tension has been 
proposed recently in [47]. 

In [14] the argument was extended also to the case in which the state a has a free energy fa < f*- 
In this case it is found that the typical decay length ^(/, T) is bigger than ^(T). The distribution of 
states then induces a distribution of lengths, and in turn this gives a distribution of local relaxation 
times that can explain the observed heterogeneity of the relaxation in glassy systems close to Tg, see 

e.g. [48]. 

*It is worth to note that the extrapolations based on the avalaible experimental data cannot really discriminate 
between different exponents in Eq. (1.56). 
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1.4.2 The potential method beyond mean field 

An interesting question is how one can estimate the (local) complexity in short range systems. A 
possible way is to consider again the two-rephca potential V{q,T), Eq. (1.24), and its Legendre 
transform F{e,T). For mean field systems V{q,T) is sketched in Fig. 1.6 and the difference between 
the secondary minimum and the primary one is T'E{T). The value of q{T) at the secondary minimum 
is given by lim^^o q{€,T), where q{e,T) = is the mean overlap of the two replicas in presence 

of a coupling proportional to e. The function q{€, T) is sketched in Fig. 1.7 in the different regions of 
temperature. Below the extrapolation of q{e, T) down to e = starting from high values of e gives 
the value of q{T). 

In short range systems, as the metastable phase corresponding to the secondary minimum has a 

finite lifetime, the true potential V{q) is a concave function of q and has only one minimum in g = 
above Tk [41]. For e large enough, the phase in which the two replicas are highly correlated is stable. 
However, for any T > Tk it exists a value ec{T) where a first order transition to the small q phase 
happens (dashed lines in Fig. 1.7). One expects that ec(T) > for T > Tk and that ec{TK) = 0, so 
that the correlated phase becomes stable up to e = for T < Tk- For e < ec(T) the correlated phase 
is metastable. This means that if one prepares the system at e large enough and slowly decreases 
the value of e below e^, the system follows the metastable branch of the curve q{e) until, after some 
time, a bubble of the stable phase nucleates driving the transition to g ~ 0. But, if the change of e 
is fast enough, and if T is close to Tk, one should be able to "supercool" the correlated phase up to 
e = and to extrapolate the value of q{T) corresponding to the metastable minimum at e = 0. The 
knowledge of the curve q{e) up to e = in the metastable branch allows to compute V{q{T),T) and 
the complexity E(T) as a function of T [41, 49, 50]. 

An ambiguity in the definition of S(T) is present because the function g(e) below eg (slightly) 
depends on the time scale and in general on the history of the system. However one can reasonably 
expect (relying on similar results obtained for Ising models, see e.g. [30, 51]) that the ambiguity is of 
the order of exp[— (e^ — e)~^] for > e so it becomes smaller and smaller on approaching Tk- Close 
to Td the ambiguity becomes very large and S(r) cannot be properly defined in short range systems. 

1.4.3 A first principles computation of the surface tension 

A way to compute the free energy barrier for nucleation AF(T) using again the two-replica potential 
V{q, T) has been recently proposed [46, 47]. Indeed, the potential V{q, T) allows to realize the situation 
considered in section 1.4.1 in a way that is suitable for analytical computations. 

The configuration a is a reference (frozen) configuration that belongs to an equilibrium state at 
temperature T . The configuration r is constrained to have a fixed overlap q with cr, so if q = q{T) it 
belongs to the same state. Consider now a system with long but finite range interactions, whose scale 
is 1/7, 7 ~ 0, enclosed in a volume V = N^~'^, N ^ 00, i.e. the thermodynamic limit is taken at the 
beginning of the calculation. Consider an adimensional space variable x obtained rescaling the space 
by 7, i.e. J df^x = N. We can define a local overlap q{x) averaging the overlap over a large volume of 
linear dimension smaller than I/7, and consider the potential V[q{x),T] as a functional of the local 
overlap^ q{x)- A configuration r such that 

1 qix)^q{T) for 1x1 ^00, 

I q{x) ^0 forx = , 

^This is the same procedure used in the study of nucleation problems, where the free energy is considered as a 
functional of the local corse-grained order parameter, e.g. the magnetization or the density. 
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Figure 1.7: (From [41]; Tc corresponds to Td) Sketch of the function q{e) in short range system (dashed 
hne). A first order transition happens at ec{T) > for T > Tk] at Tk, ec{TK) — 0. The correlated 
phase is metastable for e < ec(T) and follows approximately the mean field behavior (full line). For 
T ^ Td the metastability limit of the correlated phase is around e = and the complexity cannot be 
defined. 



is in the same state of cr outside some bubble of radius R and is in another state inside the bubble. The 
quantity AF{T) = V[q{x),T] — V{q{T),T) represents exactly the free energy cost of this configuration 
with respect to the configuration in which the two replicas are in the same state in all the points of 
the space, so it is exactly the free energy barrier defined in section 1.4.1. The overlap profile q{x) has 
to be determined by minimizing V[q{x),T] with the boundary conditions (1.58) in order to find the 
most probable transition state for the nuclcation [46, 47]. 

In systems with long but finite range^*' (Kac spin glasses) it has been shown [45] that the potential 
V[q{x),T] has a form very similar to the mean field one (1.35) 



^"Prom now the discussion will be not technical; for all the technical details as well as for a deep discussion of many 
important issues the reader should refer to the original papers [45, 46, 47]. 
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where Zmn[Q{x)] is the partition function of an nm-times rephcated system such that in each m x m 
subblock the first repHca has overlap q{x) with the other m — 1 rephcas (as in mean field). The 
partition function has the form 

Zmn[q{x)] = I VQ{x)e^'^'^^^^^ , (1.60) 



where the matrix Q{x) respects the constraint above, i.e. it has a structure similar to (1.39), and the 
action S[Q{x)] has the form 

S[Q{x)\ = j d''x{K[Q{x)\ + f[Q{x)\] , (1.61) 

with K[Q{x)] a kinetic term^^, K[Q{x)] ~ -|Tr [VQ(a;)]^, and f[Q{x)] a potential identical to the 
mean field one given in Eq. (1.37). The mean field potential then plays the rolo of a local potential 
in each volume ^ while the contributions due to space variations on a scale I/7 are taken into 
account by the kinetic term. 

For 7 ^ 0, if one looks to homogeneous solutions Q{x) = Q, all the results of the mean field model 
are reproduced. To look for nonhomogeneous solution respecting the boundary conditions (1.58), an 
ansatzoi the form (1.39) in each point x has been proposed [46]; if the potential has to been minimized 
also w.r.t. q{x)^ one can assume that r = q vn each point x as in the homogeneous case. This is the 
simplest possible ansatz and one obtains 

V[q{x),T] = d'^xl^-[Vq{x)f + V{q{x),T)^ , (1.62) 

where V{q, T) is the mean field potential. Then the equation for q{x) has the form 

V\{x) = ^ , (1.63) 

and the boundary conditions (1.58) have to be imposed to the solution. If one is able to solve 
Eq. (1.63), substituting the solution q{x) into the potential one can compute the barrier A_F(T) = 
V\^{x),T] - V{q{T), T). Subtracting from the barrier the bulk contribution -TY.{T)R'^, one gets an 
estimate of the surface tension. A typical profile of the solution and the corresponding surface tension 
are reported in Fig. 1.8. 

However, an approximate solution is possible if one looks for spherical solutions q{r) with r = \x\ 
and, in the limit of large radius R, approximates the Laplacian, close to the interface, with 

In this case the problem becomes planar so the radius of the droplet remains undetermined. For a 
given radius R of the droplet, the bulk term^ is simply [V{q{T),T) - V{q,Q)\R'^ = -TY.{T)R'^. To 
estimate the surface tension, i.e. the contribution to the integral (1.62) due to the interface, note that 



the quantity E = ^ \'<^) ~ ^(5'-^) conserved and is equal, recalling that, for r — > 00, ^ — > 0, to 
V{q{T),T), so one has, for r ~ ii, 

^ = ^2[Viq,T)-ViqiT),T)] , (1.65) 



^'^The coefficient of Tr[V(5(3;)]^ also depends on Q{x). This dependence is neglected here but does not affect the 
results. 
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Figure 1.8: (From [47]) A typical instanton profile (full line) close to Tk- In the inset, the surface 
tension as a function of the droplet size is reported. 

and the contribution coming from the region r ~ i? to the barrier V[q{x),T] — V{q{T),T) is, defining 
r_ suchi2 that V{q{r_),T) = F(g(T),r), 

^ ^ (1.66) 

R"-' / dq^2[V{q,T)^V{q{T),T)] , 

so we get the following expression for the surface tension [46]: 

rq(T) 

T(T) = / dq^2[V{q,T)-ViqiT),T)] . (1.67) 

Jq- 

As the difference q{T) — q^ is always of order 1, the surface tension scales as 

T(r) ~ ^Viq^a.,T)-ViqiT),T) (1.68) 

and is finite at Tk- The outcome of the simplest instanton calculation is that 9 = d— 1 and T{Tk) 0. 
This leads to the scalings (1.57). 

It has been recently found that a more refined calculation that includes replica symmetry breaking 
at the interface reduces the surface tension; from this observation an argument that leads to = d/2 
has been proposed. However, a detailed theory is still missing. 




Note that for r < r_ the approximation surely breaks down, otherwise would become an imaginary number. 



Chapter 2 

The ideal glass transition of Hard 
Spheres 

2.1 Introduction 

The question whether a Hquid of identical Hard Spheres undergoes a glass transition upon densification 
is still open, see e.g. [52, 53, 54, 55]. It is interesting to apply the replica method to the Hard Spheres 
liquid, following what has been done for Lennard- Jones systems [15, 41, 49] in order to investigate 
the possibility of the existence of a Kauzmann transition. 

In an Hard Sphere system, on increasing the density, and if crystallization is avoided, one can 
access the metastable region of the phase diagram above the freezing packing fraction = 0.494, 
where (f = ^^y^ , D is the Hard Sphere diameter, N is the number of particles and V is the volume of 
the container. In this region the dynamics of the liquid becomes slower and slower on increasing the 
density. The particles are "caged" by their neighbors, and the dynamics separates into a fast rattling 
inside the cage and slow rearrangements of the cages. The typical time scale of these rearrangements 
increase very fast around ipg 0.56 and many authors reported the observation of a glass transition 
at these values of density [25, 26]. Note that the Kauzmann density is expected to be larger than the 
experimental glass transition density, as at (fiK the relaxation time is expected to diverge so that the 
system freezes in a metastable state, on the experimental time scale, for a density '^g smaller than (pK- 

A related problem is the study of dense amorphous packings of Hard Spheres. Dense amorphous 
packings are relevant in the study of colloidal suspensions, granular matter, powders, etc. and have 
been widely studied in the literature [59, 60, 61, 62, 63, 64, 65, 66]. The metastable states of the Hard 
Sphere liquid provide examples of such packings: when the system freezes in one of these states, if 
one is still able to increase the density in order to reduce the size of the cages to zero (for example 
by shaking the container [60, 61] or using suitable computer algorithms [62, 63, 66]), a random close 
packed state is reached. The problem of which is the maximum value of density fc that can be reached 
applying this kind of procedures has been tackled using a lot of different techniques, usually finding 
values of tpc in the range 0.62 -=-0.67. Another interesting problem is to estimate the mean coordination 
number z, i.e. the mean number of contacts between a sphere and its neighbors, in the random close 
packed states. Many studies addressed this question usually finding values of z ^ 6. 

Few estimates of the configurational entropy for Hard Spheres are currently available [54, 57] and 
indicate a value of ifK in the range 0.58 -j- 0.62. These estimates were obtained following numerical 
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procedures already succesfuUy applied in Lcnnard-Jones systems [49, 56] or the method described in 
section 1.4.2; for the Lennard- Jones liquid the results compare well with the theoretical predictions 
of the replica theory [41, 49]. A tentative replica study of the Hard Spheres glass transition, based 
on the potential method described in section 1.3.2, can bo found in [58], where a good estimate of 
ipK ^ 0.62 was obtained. However, the configurational entropy computed in [58] is two orders of 
magnitude smaller than the one found in numerical simulations. This negative results is probably due 
to some technical problem in the assumptions of [58]. 

For technical reasons the real replica method (see section 1.3.1) of [15, 37, 41, 49, 67], that gives 
very good results for Lennard- Jones systems, cannot be extended straightforwardly to the case of Hard 
Spheres; indeed at some stage is was assumed that the vibrations around the equilibrium positions 
were harmonic in a first approximation. This approximation is not bad for soft potentials, but it 
clearly makes no sense for hard spheres. 

In this chapter a way to adapt the replica method of [15] to the case of the Hard Sphere liquid, 
and in general of potentials such that the pair distribution function g{r) shows discontinuities, will 
be developed. This allows to compute from first principles the configurational entropy of the liquid 
as well as the thermodynamic properties of the glass and the random close packing density. A very 
good estimate of the configurational entropy, that agrees well with the recent numerical simulations 
of [54, 57], a Kauzmann density in the range 0.58 -j- 0.62 (depending on the equation of state we 
use to describe the liquid state), and a random close packing density in the range 0.64 0.67, are 
found. Moreover, the mean coordination number in the amorphous packed states is found to bo z = 6 
irrespective of the equation of state used for the liquid, in very good agreement with the result of 
numerical simulations [62, 63, 66]. 

2.2 The molecular liquid 

The starting point of the real replica method described in section 1.3.1 is the free energy of a system 
of m copies of the original liquid constrained to be in the same metastable state. This means that 
each atom of a given replica is close to an atom of each of the other m — 1 replicas, i.e. , the liquid is 
made of molecules of m atoms, each belonging to a different replica of the original system. In other 
words the atoms of different replicas stay in the same cage. The problem is then to compute the free 
energy of a molecular liquid where each molecule is made of m atoms. The m atoms are kept close 
one to each other by a small inter-replica coupling that is switched off at the end of the calculation, 
while each atom interacts with all the other atoms of the same replica via the original pair potential. 
This problem can be tackled by mean of the HNC integral equations [68] . 

2.2.1 HNC free energy 

The traditional HNC approximation can be naturally extended to the case where particles have internal 
degrees of freedom and also to the replica approach where one has molecules composed by m atoms. 

Let X = {xi, ■ ■ ■ ,x^}, x^ e be the coordinate of a molecule in dimension d. The single-molecule 
density is 

N m 

P(^) = (En'^fea-^a)) ' (2-1) 

i—1 a—1 
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and the pair correlation is 

1,N m m 

p{x)g{x, y)p{y) = (1^11 ' 11 ^fe*- ' U})) ' (^.2) 

i,j a=l 6=1 

Define also h{x,y) = g{x,y) — 1. The interaction potential between two molecules is v{x,y) = 

Ea^(l^a-y„l)- 

The HNC free energy is given by [15, 68] 



P^[p{x),g{x,y)] = ^ j dxdy p{x)p{y)[g{x,y)\ogg{x,y) - g{x,y) + 1 + f3v{x,y)g{x,y)] 
+ j dxp{x)[\ogp{x) - 1] + ^ E [hpT , 



where 



Tr[/ip]" = y da;i---da;„/i(a;i,a;2)p(a;2)/i(a;2,a;3)p(a;3)---/i(a;„_i,a;„)p(a;„)/i(a;„,a;i)p(a;i) . (2.4) 

For Hard Spheres the potential term vanishes, / dxdy p{x)p{y)g{x,y)v{x,y) = 0, so the reduced free 
energy will not depend on the temperature in all the following equations. Similarly, all the free 
energy functions that will be consider below do not depend on the temperature once multiplied by (5. 
In principle one could stick to ,/? = 1 and slightly simplify the formulae. However, it is useful to keep 
explicitly in order to conform to the standard notation for soft spheres (or for hard spheres with 
an extra potential). 

Differentiation w.r.t g{x, y) leads to the HNC equation: 

^ogg{x, y) + Pv{x, y) = h{x, y) - c{x, y) , (2.5) 

having defined c{x, y) from 

h{x,y) = c{x,y) + j dzc{x,z)p{z)h{z,y) . (2.6) 
The free energy (per particle) of the system is given by 

"^("^'^^^ /^V"^ *[p(a;),S'(a;,y)] , 

iVm p(x),g(x,v) ^2.7) 

$(m,T) = m(j){m,T) , 

and once the latter is known one can compute the free energy of the states and the complexity using 
Eq.s (1.20). 

2.2.2 Single molecule density 

The solution of the previous equations for generic m is a very complex problem (it is already rather 
difficult for m = 2). Some kind of ansatz is needed to simplify the computation, that may become 
terribly complicated. 

The single molecule density encodes the information about the inter-replica coupling that keeps all 

the replicas in the same state. One can assume that this arbitrarily small coupling has already been 
switched off, with the main effect of building molecules of m atoms vibrating around the center of 
mass -X_ e M!^ of the molecule with a certain "cage radius" A. The simplest ansatz for p{x) is then [15] 



p{x) =pj dXl{p{x, - X) , j dup{u) = 1 , (2.8) 
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with 

^2 

p(u) = ^--!^ ^ , (2.9) 
(\/2^)<i ^ ' 

and p = J dx p{x) the number density of molecules. With this choice it is easy to show that 

j (ixp(a;)[logp(a;)-l] =logp- 1 + ^(1 -m)log(27r^)- ^logm+^(l-m) . (2.10) 

2.2.3 Pair correlation 

As the information about the inter-replica coupling is already encoded in p{x), a reasonable ansatz 
for g{x, y) is: 

9{x,y) = J{9{\x^-yJ) , (2.11) 

a 

where g{r) is rotationally invariant because so is the interaction potential. It is useful to define 
G{r) = [g{r)]'^. Using the ansatz above, it is easy to rewrite the free energy (2.3) as follows: 



where 



= ^ y dr{m[Fo{r)r-'Frir) - [Fo(r)]'" + 1 + m[Fo{r)r-' F,{r)} 
dxp{x)[\ogp{x) -1]+^Y1 ^^Tr[/ip]" , 

^n>3 " 

Fp{\r\) = j dudvp{u)p{v)g{\r + u-v\)[\ogg{\r + u-v\)]P, 
Fv{\l\) = J <^^iC^2!P(^^)p(^^)5'(|zi + ^^ ~I!|)/3^^(|r + ^i~^!|) • 



(2.12) 



(2.13) 



Note that as g{r) and v{r) are rotationally invariant, so are Fp{r) and Fy{r). If p{u) is given by 
Eq. (2.9), one gets 

Fi\r\) = ldu^^Ji\r + u\), (2.14) 
where /(r) G {g{r), g{r) \ogg{r), g{r)(iv(r)}. For Hard Spheres Fy = 0. 

2.3 Small cage expansion 

The strategy of [15] was to expand the HNC free energy in a power scries of the cage radius A, 
assuming that the latter is small close to the glass transition. The expansion is carried out easily 
if the pair potential v{r) and the pair correlation g(r) are analytic functions of r. However this is 
not the case for Hard Spheres, as g{r) vanishes iov r < D and has a discontinuity in r = £>, so the 
formulae of [15] for the power series expansion of ^ cannot be applied to our system. 

It is crucial to realize that, independently from any approximation, in the limit ^ ^ 0, the partition 
function becomes (neglecting a trivial factor) the partition function of a single atom at an effective 
temperature given by (3ef f = Pm. In the case of Hard Spheres, where there is no dependence on the 
temperature, the change in temperature is irrelevant. 

In [15] it was shown that the first term of the expansion is proportional to A if g{r) is differentiable. 
It will be shown in the following that, in the case of Hard Spheres, the presence of a jump in g{r) 
produces terms 0(\/!A) in the expansion. At first order one can focus on these terms neglecting all the 
contributions of higher order in vG4. This means that one can neglect all the contributions coming 
from the regions where g{r) is differentiable and concentrate only on what happens around r = D. 
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2.3.1 Expansion of Fo(r) 

The contribution one wants to estimate comes from the discontinuity of g(r) in r = D. Thus to 
compute this correction the form of g{r) away from the singularity is irrelevant and one can use the 
simplest possible form of g{r). 

It is convenient to discuss first the expansion of FQ{r) in = 1. The simplest possible form of g{r) 

is 

g{r) = e{r - D)[l + (y - l)e-^('--^)] ; (2.15) 

the amplitude of the jump of g{r) in r = D is given by y. Remember that r € M and r = |r| S M"*". 
As the functions Fq and g are even in r, one can write 

/C30 /'OO 
dr[Fo{rr - 9{rr] = 2 / rfr[Fo(r)'" - ^(r)'"] . (2.16) 

Defining 

2 /"^ 2 

erf(t) = / dx e"^^ , 
Jo 



@{t) = \[l + eri{t)] 



(2.17) 



these functions play the role of "smoothed" sign and ^-function respectively; note also that the function 
6(t) goes to as e~*^ for t — > — oo. Then 

/ du^^^e{r + u-D) = ]-\l + eii(''-^S]\=Q('^^S\ , (2.18) 

and 

'r-D-2An 



4A 



(2.19) 



As r > one can neglect the terms proportional to 9 in Eq. (2.19), that give a contribution 

of order exp(— £>^/^) for A — > 0. Defining the reduced variable t = {r — D)/\/4A: 

git) = e{t)[l + {y-l)e-^'^*], ^^^^^ 

Fo{t) = Bit) + {y-l)e-^'^^*e^^'"e{t + ^lVA) , 

and Eq. (2.16) becomes 

/•OO /'OO 

/ dr[Fo{rr - gm =2VA I dt[Fo{tr - 9{tr] = 2VAQ{A) . (2.21) 

If the function Q(A) has a finite limit (3(0) for A — > one has Q{^A) = Q(0) + o(l) and the leading 
correction to the free energy is O(\/]4(3(0)). The limit for ^ of Q(A) is formally given by 

/•OO 

Q(0) = / dt [9(0" - ^(t)"] = l/^g™ (2.22) 



where = F is the jump of G(r) = .g(r)'" in r = D and Q„ = dt [9(4)"* - 6l(i)'"]. It is easy to 
show that Qm is a finite and smooth function of m for m, / 0, that 

0„ = (1 - m)0o + 0[(m - 1)2] , 

(2.23) 



/OO 
rft9(i)log9(t) ~ 0.638 , 
-CSO 
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and that Qm diverges as Qm ^ ^7r/4m for m, —f 0. Finally, recalling that G(r) = [(?(r)]"*, 

\ j drFoirr = \ j drG{r) + 2^/AYQm • (2.24) 
In dimension d > 1, recalling that FQ{r) and G{r) are both rotationally invariant, one has 

j rfz:[fb(r)" - G(r)"] = fldj^drr'^-^ [FoW™ - G(r)'"] , (2.25) 
where ild is the solid angle in d dimension, fid = 2Tr'^^^ /r(d/2). The function Fo{r) can be written as 

where i is the unit vector e.g. of the first direction in M.'^ . For small V^, the u are small too. The 
function g{\ri + u\) is differentiable along the directions orthogonal to i. Expanding in series of u^, 
jjL^l, &t fixed ui, one sees that the integration over these variables gives a contribution 0{A), so 

Fo{r)= dui^=g{r + ui) + 0{A) , (2.27) 

as in the one dimensional case. The function Fo(r)'" — G{r)'^ is large only for r — D ~ y/A so at the 
lowest order one can replace r'^~^ with D'^~^ in Eq. (2.25), and obtains 

J dr [iio(r)'" - G(r)'"] = naD'^-'^ dr [Foir)"" - G(r)'"] . (2.28) 

The last integral, with Fo{r) given by Eq. (2.27) is the same as in d = 1, so 

^ J drFoirr = \j drG{r) + y/AYY.a{D)Qm , (2.29) 

where T,d{D) is the surface of a d-dimensional sphere of radius D, T,d{D) = ndD^~^. This result can 
be formally written as 

Foirr ~ G(r) + 2VAYQ^Si\r\ - D) = G{r) + Qo{r) (2.30) 
as the correction comes only from the region close to the singularity of ^(r), r — D \fA. 

2.3.2 GlogG-term 

The correction coming from the term J dr mFQ(r)™~^ Fxir) will now be estimated. Using the same 
argument as in the previous subsection, one can restrict to d = 1. Note first that ^b('')> for |r — D| ~ 
\fA^ has the form 

Fo(r) = V e i''-^] + o{sa) , (2.31) 



/4A 

where y is the jump of the function g(r) in r — D. Similarly, ^i(r') has the form 

ig{r)logg{r)+OiA) , |r - 7?| » , 

riir) — < / \ , , (2.62) 

\ylogye[^)+o{VA) , \r-D\r^VA. 



The integral 



POO 

/ dr[mFo{rr-^Fi{r) -mg{rr log gir)] (2.33) 
Jo 
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has then two contributions: the first comes from the region |r — _D| ^ \J A and is of order A as if the 
function g{r) were continuous. The other comes from the region |r — D| ~ \fA and is of order \fA as 
in the previous case. To estimate the latter one can use again the reduced variable t and approximate 
Fxif) ~ 2/logye(t), Fo(i) ~ vQ{t). Then 



/•CSO 

/ dr\mF^{TT-^Fr{T) - m^W'" logff(r)] = Y\o^Y IsfAQ^^ o{sfA) , (2.34) 
Jo 

in d = 1 and finally, in any dimension d, 

^ J drmFo{rr-^F,{r) = ^J drG{r)\ogG{r) + VAY logY ^a{D)Qm ■ (2.35) 



2.3.3 Interaction term 

Substituting Eq. (2.8) in the last term of the HNC free energy one obtains 

Tr [/ip]" = fp J '^^1 ' ' ' dX^n J ■ ■ ■dUnP{u\) ■ ■ ■ p{Un)h{X.i — X3,Ul—U2) ■ ■ ■ h{X.n—Ki,Un-ui) , 

(2.36) 

where h{X, u) = nr=i 9{X + u^) - 1 and p{u) = 0^=1 P(^a) with p{u) given by Eq. (2.9). 

The correction 0{-</A) to this integral comes from the regions where \Xi - Xi+i\ = D + 0(\/A) 
for some i = 1, - ■ ■ ,n. In these regions the functions h such that their arguments are not close to 
the singularity can be expanded in a power series in u, the correction being 0(^4) [15]. Thus one can 
write, defining H{r) = G{r) — 1: 

p-"Tr [/ip]" = j dX^--- dX„H{X^ -X^)--- H{X^ - X^) + n j dX^- ■ ■ dX^ j duidu2 x 

xp(ui)p(u2) [h{X^ -X^,ui- U2) - H{X^ - X^)] H{X^ - Xg) • • • H{X^ - X^) = 

JdX,... dX^HiX, -X,)... H{X^ - X,) 

+ njdX,... dXMKi - X^)H{X^ - Zs) • • • H{X^ - X^) , 
where in the last step Eq. (2.30) has been used: 

j duidu2 Piui)p{u2) [h{r, «i - U2) - H{r)] = Fo(r)'" - G{r) = Qo{r) . (2.38) 

Collecting all the terms with different n one has 

- ^ ^Tr [hpr ~ 2 E H^^Tr i?" + y _/ dX,dX,dX,Qo{X, - X,)H{X, - JC,) x 



(2.37) 



n>3 n>3 
X 



^(_l)n^-3 fdX^--- dX„H{X^ H{Xn - ^l) = 

n>3 

2 E ^^r^rH^ -fjj dX,dX^dX^Q^{X^ - X^)H{X^ - X^)C{X^ - X,] 



(2.39) 



Substituting the expression of Qoir) and recalling that from the definition of C(X) one has 

p j dZH{X - Z)C{Z -Y) = H{X -Y)- C{X - Y) , (2.40) 
the following result is obtained (in any dimension d): 

- ^ ^^Tr [hpr = ^Y1 ^^p"Tri?" - NpQ^^/AyY,^{D)[H{D) - C{D)] . (2.41) 



n>3 n>3 
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Figure 2.1: The equilibrium complexity ^{ifi) as a function of the packing fraction. 

2.4 First order free energy 

Substituting Eq.s (2.29), (2.35) and (2.41) in Eq. (2.12) one obtains the following expression for the 
HNC free energy at first order in ^/A: 

= ^ = PFo{A) + f3F,,[G{r)] + pAF[A, G{r)] , 



= I d^r [G{r) log G(r) - G(r) + l] + logp- 1 



+ ■ 



2p J {2ttY 



\og[l + H{k)]+H{k)--H{kf 



(2.42) 



(3Fo='^{l-m) log(27rA) + ^ (1 - m) - ^ log m 



= pQ„ VISd(D) G{D) [ log G{D) -l-H{D)+ G{D))\ , 
where Qm = <3o(l — m) + o((m — 1)^), Qo ^ 0.638 and the Fourier transform has been defined as 

H{k) I dre^'^^'Hir) . (2.43) 



At the first order in ^fA one only needs to know the function G{r) determined by the optimization 
of the free energy at the zeroth order in \/A, i.e. the usual free energy Feq[G{r)]: it satisfies the 
HNC equation log G(r) = F[{r) — C(r). Substituting this relation in /3AF one simply obtains /3AF = 
-pQm^i:d{D)G{D). 

The derivative w.r.t. A leads to the following expression for the cage radius: 

d 



1 — m 



Qm p^d{D)G{D) ' 
which in d = 3 becomes, defining again Y = G{D): 

\/A* 1 - m 1 



D 



(2.44) 



(2.45) 



where ip ■ 



is the packing fraction. Substituting this result in pAF one has pAF{A*) = d{m— 1). 
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Figure 2.2: Phase diagram of the molecular liquid. For m < m* (full line) the system is in the liquid 
phase, for m > m* it is in the glass phase. 

Finally, the expression for the replicated free energy in d = 3 is 

/3$(to, = PFeqi'f) + ^{l-m) log[27rA*(m)] + ^(m - 1) - ^ logm . (2.46) 
Note that for Hard Spheres one has (3Ff.q{if) — ~S{(p), S being the total entropy of the liquid. Then 
N dl3<P 3, 3,^ d\ogA*{m) 3m- 1 

\ n p* N 3, 3m ,^ ,rflogyl*(m) 3, 
E(m, ^) = m(3f* - /3$ = 5(^) - - log[27rA*(m)] + — (1 - m) ^ + - logm . 

For small enough density the system is in the liquid phase and m is equal to 1. For m — 1 one has: 



VA^) _ 1 



D 8Qo(pY{^) ' 
SM ^ -/3/*(l, ^) - ^ log[2^A*(l)] , (^-^^^ 

This allows for a computation of E(iy9) once S{(p) and F(i^) are known. Note that 1 + AipY{(p) = 
(3P/p = — <y5^, so a model for S{(p) (or Y{(p)) is enough to determine all the quantities of interest. 

2.4.1 Results from the HNC free energy 

The functions S{ip) and Y{ip) have been computed solving numerically the classical HNC equation for 
the Hard Sphere liquid wp to ip — 0.65. This allows to compute /3$((/5, m) and gives access to all the 
thermodynamic quantities using Eq.s (2.47) and (2.48). In this section we discuss the results of this 
computation. The sphere diameter will be set to D = 1 in the following. 

Equilibrium complexity 

The equilibrium complexity E(<p) is given by Eq. (2.48). It is reported in Fig. 2.1. A complexity 
E ~ 1 is obtained as found in previous calculations in Lennard- Jones systems [15, 41, 49, 67], as well 
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Figure 2.3: Entropy of the liquid (full line) and of the glass (dashed line). The two curves intersect at 
ipK = 0.582 where they are tangent and consequently the pressure is continuous at the glass transition. 
The entropy of the glass goes to — oo at ip = Lpc = 0.640, so the glassy phase does not exist above ipc- 
The dot-dashed line is the entropy of the equilibrium states of the liquid, Svibi^p) — S{(p) — ^{^)- 

as in the numerical simulations [49, 56]. The complexity vanishes at (fK — 0.582, that is the ideal 
glass transition density -or Kauzmann density- predicted by the HNC equations. 

Phase diagram in the {ip, m) plane 

As discussed above, it exists a value of m, m* (ip), such that for m < m*{(p) the system is in the liquid 
phase, and for m > ■m*{(p) is is in the glassy phase. It is the solution of E(m, ip) = 0, where E(m, (p) 
is given by Eq. (2.47). In Fig. 2.2 m* is reported as a function of p. Clearly, m* = 1 at 1^9 = ipK and 
m* < 1 for p> > (fK- m* vanishes linearly at p>c = 0.640. As will be shown in the following, above this 
value of p the glassy state does not exist anymore. 

Thermodynamic properties of the glass 

The knowledge of the function to* {ip) allows to compute the entropy of the glass. Indeed, the free 
energy does not depend on m in the whole glassy phase, and it is continuous along the line m = to* {ip), 
so the entropy of the glass is given by 

S,,..si^) = -PF,,.M^y-^^^ (2.49) 

m*{(p) 

This relation is true for to* < 1. Below Lpj^ one has to* > 1 and the liquid phase is the stable one. 
Eq. (2.49) for to* > 1 gives the entropy of the lowest states in the free energy landscape (see below) 
and can be regarded as the analytic continuation of the glass entropy below LpK- The reader should 
notice that the glass phase for to* > 1 does not have a simple physical meaning and the interesting 
part of the curves for the glass is in the region ip > pK ■ 

In Fig. 2.3 the entropies of the liquid and the glass are reported as functions of the packing fraction. 
The glass phase becomes stable above pK = 0.582; note that the entropy of the glass is smaller than 
the entropy of the liquid, i.e. its free energy is bigger than the free energy of the liquid. The same 
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Figure 2.4: Reduced pressure (3P/p of the liquid and the glass as functions of the packing fraction. 
The pressure is continuous at i^k- In the inset, the inverse reduced pressure is plotted; in the glass 
phase it is proportional to (pc — f- 



happens also in Lcnnard- Jones systems and in mean-field spin glass systems. However the physically 
relevant parts of the curves are the liquid one for ip < tpx and the glassy one for tp > ipK- 
The reduced pressure, 

= -(/3— , (2.50 

P dip 

is reported in Fig. 2.4. It is continuous at ipK and the glass transition is a second order transition 
from the thermodynamical point of view. Note that the pressure in the glass phase is well described 
by a power law and it has a simple pole at pc- 

^EEtll^^_^ (2.51) 

P <Pc- ip 

as one can see from the inset of Fig. 2.4 where the inverse reduced pressure is plotted as a function 
of p. 

For p pc the pressure of the glass diverges and its compressibility x — vanishes and 

consequently p}c is the maximum density allowed for a disordered state, i.e. it can be identified as 
the random close packing density. The value pc = 0.640 is in very good agreement with the values 
reported in the literature. Note that the compressibility jumps downward on increasing ip across tpx, 
i.e. the compressibility of the glass is smaller than the compressibility of the liquid. 



Cage radius 

The cage radius is given as a function of m in Eq. (2.45). In Fig. 2.5 the cage radius in the liquid phase, 
y/ A*{1), see Eq. (2.48), and the cage radius in the glass phase, defined as y/ A* (m*), are reported. 
As Qm ~ y/Tr/im for m ~ 0, the cage radius vanishes as V m* for m* ~ 0, i.e. it is proportional to 
y/ipc — ip. The vanishing of the cage radius for ip ipc means that at ipc each sphere is in contact with 
its neighbors, that is consistent with the interpretation of pc as the random close packing density. 
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0.08 




Figure 2.5: Cage radius y A (in units of D) in the liquid and in the glass phase as function of ip. 



Complexity of the metastable states 

From the parametric plot of Pf *{m, ip) and E(m, (p) given in Eq. (2.47) by varying m, one can recon- 
struct the function E(/3/) for each value of the packing fraction. This function is reported in Fig. 2.6 
for some values of ip below and above ipx- The function Y,(f3f) vanishes at a certain value (3fmim that 
is given by Eq. (2.49). The saddle-point equation that determines the free energy of the equilibrium 
states is, from Eq. (1.15), 



= 1 



(2.52) 



From Fig. 2.6 it is clear that this equation has a solution /* > fmin for ip < pK = 0.582. Above (pK 
Eq. (2.52) does not have a solution so the saddle point is simply /* — /,„i„ and the systems goes in 
the glass state. In this sense, the free energy fmin of the lowest states below (pK can be regarded as 
the analytic continuation of the free energy of the glass, see Fig. 2.3. The curves S(/3/) in Fig. 2.6 
have been truncated arbitrarily at high /?/. One should perform a consistency check to investigate 
where the higher free energy states become unstable (i.e. , to compute fmax)- This is not trivial and 
is left for future work. 



2.5 Correlation functions 

The replica approach also allows the study of the pair distribution function g{r) in the glass state. In 
principle a full computation would require the evaluation of the corrections proportional to ^/~A in the 
correlation functions of a molecule. However these terms will be neglected, as one can argue that they 
are small, and one can start again from the simple ansatz (2.8), (2.11) for the correlation function of 
the molecules, in which the information on the shape of the molecule is only encoded in the function 
p{x); these corrections should be physically more relevant and interesting. 

As will be shown in the following, the correlation function of the spheres in the glass is very 
similar to the one in the liquid but develops an additional strong peak (that becomes a 5-function at 
ipc) around r ^ D. The integral of the latter peak is related to the average coordination number of 
the random close packings. 
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Figure 2.6: Complexity of the metastable states as a function of their free energy /3/ for different values 
of ip. From left to right, <f = 0.45,0.5,0.55,0.58,0.6,0.62,0.63. The curves are truncated arbitrarily 
at high (3f. The dashed line has slope 1. 



2.5.1 Expression of g{r) in the glass phase 

The following form for the pair distribution function of the molecular liquid was assumed in Eq.s (2.8) 
and (2.11): 

P m 

P2{x, y) = p{x)g{x, y)p{y) ^P^j dXdY J| p{xa - X)g{\xa - ya\)p{ya - Y) ■ (2.53) 



a=l 



The pair correlation g{r) of a single replica is obtained integrating over the coordinates of all the 
replicas but one: 

gihi ^ yj) = P^^ y" dx2--- dx^dy^ ■ ■ ■ dy_^^^p2{x, y) . (2.54) 
Using Eq. (2.53) one gets, with some simple changes of variable: 

gir) — g{r) / dud2ip{u)p{v)FQ{\r + u^ll\)™'''^ , 



(2.55) 

where Fo{r) is defined in Eq. (2.13). The HNC free energy is optimized by g{r) — G{ry^"\ where 
G{r) is the HNC pair correlation. Thus the following expression for the pair correlation of a single 
replica is obtained: 



5(r) = G(r)- / du 



e 



(2.56) 



F,,(r)^ I du-^JL-G{\r + u\)- 



For m = 1, i.e. in the liquid phase, this function is trivially equal to G{r). This is not the case in the 
glass phase where m < 1. 



2.5.2 Small cage expansion of the correlation function 

To expand Eq. (2.56) for small A, note first that, ii r ^ D, the function g{r + u) can be expanded in 
powers of u, and the first correction to g{r) is of order A. Then, as before, one can concentrate only 
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on what happens around r — D. As already discussed in section 2.3, around r = D one has, as in 
Eq. (2.31), G{r) ~ Ye{r - D) and 



i^o(r)~F^e('^') , (2.57) 



and Eq. (2.56) becomes 



^2 

gir) = YOir - D) [ du 'iJ^ 6 



\r + u\ ~ D'' ""-^ 



, e '- 7L_ — . (2.58) 

Applying the same argument used in section 2.3 when studying the function i^o(^) in dimension c? > 1, 
it can be shown that the integration over the coordinates w^, /U ^ 1, gives a contribution 0{A). Then, 
in any dimension d: 



/OO — ^ / I 7-l\ m— 1 

-co Vi^ \ J 



(2.59) 



defining the reduced variable t = ■ The second term in the latter expression is a contribution 

localized around r = D. 



2.5.3 Number of contacts 

To compute the average number of contacts, recall that the average number of particles in a shell 
[r, r + dr], if there is a particle in the origin, is given by 

dn{r) = ndr'^-^pg{r)dr . (2.60) 

Thus the number of contacts can be obtained from the correlation function g{r). While the full 
computation of the correlation function is rather involved, here only the second term in Eq. (2.59) 
will be considered; this term is proportional to a Gaussian with variance 0{-</A) that becomes a 

S{\r\ — D)-function in the limit A ^ 0. 

The value of the number of spheres in contact with the sphere in the origin is given by 

pD+o{Va) 

z = QdP drr'^-^gir) . (2.61) 

Jd 

The first term in Eq. (2.59) gives a contribution 0(\/A) that can be neglected. With the approximation 
r <^ D and G(r) F at the leading order in \/~A one obtains, defining the variable e = ^^^5 

z = UdD'^-^pYVlA de ^e'^^-*)' [e(t)'"-^ - l] . (2.62) 

Recalling that 

-= / rfee-(^-*)' =e(i) , (2.63) 

VTi' Jo 

observing that dt [e{t) - e{t)] = 0, and using Eq. (2.44), it follows that 

/OO 
dt Q{t) [e(t)'"-i - 1] = i:d{D)pVy/4AQm = 2d{l - m) . (2.64) 
-CSO 
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This is the expression of the average number of contacts at the leading order in a/A, to be computed 
at m = m* in the glass phase. At <^ = ipc, where m* = 0, each sphere has on average 2d contacts. 
This is exactly what is found in numerical simulations. 

Note that this result is independent of the particular expression that has been chosen for S{(p), 
Y{(p) and G{r), i.e. it might hold beyond the choice of HNC equations for the molecular liquid 
provided that the expression (2.44) for the cage radius is correct. 

The condition > 2d is required for the mechanical stability of the packings as can be understood 
by mean of a very simple argument [65]. Consider the network of forces between the spheres in the 
packed state. For Hard Spheres the forces can be considered as independent from the displacements: 
indeed, for two spheres in contact an infinitesimal displacement produces a finite change in the forcc"'^. 
Thus to each pair (ij) of spheres in contact one can associate a scalar force = Fji. The forces are 
determined by the linear system J2j ^ijiLi ~ Lj) = 0, Vi. The total number of forces, if each sphere 
has z contacts, is zN/2, while the number of equations is Nd. Thus the condition ^; > 2d is necessary 
for the system to have a solution. 



2.6 Discussion 

The results will now be compared with related ones that appeared in the literature. The main 
obstacle for a quantitative comparison is that the HNC equations are known to yield a not very good 
description of the Hard Sphere liquid at high density [68] ; typically one would obtain the right curves 
if one shifts the value of of a quantity of order 0.03. Therefore, only a qualitative comparison of 
the results coming from the HNC equations with the results of numerical simulations is possible. 
However, note that, although the expressions (2.45), (2.46) for the replicated free energy have been 
derived starting from the expression (2.3) for the HNC free energy, the final result depends only on 
the equilibrium entropy of the liquid S{(p). It is interesting then, for the purpose of comparing the 
results with experiments and numerical simulations, to consider a more accurate model for S{ip) in 
the hquid phase. We repeated the calculations of section 2.4.1 substituting the Carnahan-Starhng 
(CS) entropy [68] 



Scsif) = - log 



WJ (1- 



(2.65) 



(1 - <p)3 • 



instead of the HNC entropy in Eq.s (2.46), (2.45). All the results of section 2.4.1 are qualitatively 
reproduced using the CS entropy, but the latter gives results in better agreement with the numerical 
data. However, this procedure is not completely consistent from a theoretical point of view: one 
should always keep in mind that the aim of this work is not to present a quantitative theory, but only 
to show that the replica approach yields a reasonable qualitative scenario for the glass transition in 
Hard Sphere systems. 



2.6.1 Complexity of the liquid and Kauzmann density 

In Fig. 2.7 the equilibrium complexity 'S(ip), obtained substituting the HNC and the CS expression 
for S{(fi) and Y{ip) in Eq. (2.48), is reported. The results are compared with recent numerical results 
of Angelani et al. [57] obtained on a 50 : 50 binary mixture of spheres (to avoid crystallization) with 
^This can be shown for example by considering a potential V{r) = r~" for n 00. 



42 



CHAPTER 2. THE IDEAL GLASS TRANSITION OF HARD SPHERES 




Figure 2.7: Equilibrium complexity T,{ip) as a function of the packing fraction. The full line is from 
the HNC equation of state (see Fig. 2.1), the dashed line is from the Carnahan-Starling equation of 
state. The black dots are from the numerical computation of Angelani et al. [57], the dot-dashed line 
is extrapolated from the numerical data reported by Speedy [54] . 



diameter ratio equal to 1.2: the vibrational entropy was estimated using the procedure described 
in [49, 50] and the complexity was computed as S{ip) — Svib{ip). A quantitative comparison is difficult 
here because in the case of a mixture there can be corrections related to the mixing entropy, Smix ~ 
log 2. Nevertheless the data are in good agreement with our results. A detailed comparison would 
require the extension of the computation to binary mixtures following [49] . 

Another numerical estimate of S(</?) was previously reported by Speedy [54], who rationalized his 
numerical data assuming a Gaussian distribution of states and a particular form for the vibrational 
entropy inside a state. The free parameters were then fitted from the liquid equation of state. The 
curve obtained by Speedy also agrees with our results. 

Both the HNC and the CS estimates of the Kauzmann density {(pK = 0.582 and (px = 0.617 
respectively) fall, as it should be, between the Mode-Coupling dynamical transition that is ifMCT ~ 
0.56 [25, 26], and the Random Close Packing density that is estimated in the range cp — 0.64 0.67, 
see e.g. [59]. 

A computation of S(<^) based on very similar ideas was presented in [58], where a very similar 
estimate of (px ~ 0.62 was obtained. However in [58] the complexity was found to be S ^ 0.01, i.e. 
two orders of magnitude smaller than the one obtained from the numerical simulations. This negative 
result is probably due to some technical problem in the assumptions of [58] . 

2.6.2 Equation of state of the glass 

In Fig. 2.8 the numerical data for the pressure of the Hard Sphere liquid at high (p, obtained by 
Rintoul and Torquato [52], are reported. The data were obtained extrapolating at long times the 
relaxation of the pressure as a function of time after an increase of density starting from an equilibrated 
configuration at lower density. Also reported are the curves of the pressure as a function of the density 
obtained from the HNC and CS equations, both in the liquid and in the glass state. 

The agreement of the HNC curve with the data is not very good even in the liquid phase, due 
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Figure 2.8: Inverse reduced pressure of the Hard Sphere Uquid as a function of ip. The black dots 
are from the simulation of Rintoul and Torquato [52]. The full line is obtained from the CS equation 
of state while the dot-dashed line is from the HNC equation of state. The dashed parts of the two 
curves correspond to the (ideal) glass phase. Note that all the curves are quasi-linear functions of 
in the glass phase. 

to the modest accuracy of the HNC equation of state. However, its qualitative behavior is similar to 
the numerical data, and in particular the quasi-linear behavior of the inverse reduced pressure in the 
glass phase found in [52, 54], cx (ySc — (/s, is reproduced by the HNC curve. The HNC pressure of 
the glass diverges at ipc = 0.640 as discussed in section 2.4.1; the latter is the HNC estimate of the 
random close packing density. 

The CS curve describes well the pressure in the liquid phase [68]. Comparing the curve with 
the data of Rintoul and Torquato, one notices that the glass transition happens in the numerical 
simulation at a density pg ~ 0.56 smaller than the one predicted by the CS curve^, pK — 0.617, and 
very close to the Mode-Coupling transition density, ifMCT ^ 0.56. This is not surprising, since the 
relaxation time grows fast on approaching the ideal glass transition; at some point it becomes larger 
than the experimental time scale and the liquid falls out of equilibrium becoming a real glass. It is 
likely that the data of Ref. [52] describe the pressure of a real nonequilibrium glass, while the replica 
computation gives the pressure of the ideal equilibrium glass, that cannot be reached experimentally 
in finite time. 

2.6.3 Random close packing 

Both the HNC and CS equations predict the existence of a random close packing density Lp^ where the 
pressure and the value of the radial distribution function g{r) inr = D diverge. The HNC estimate is 
iPc = 0.640, in the range of the values [tpc = 0.64-;- 0.67) reported in the literature. The CS estimate 
is ipc = 0.683 and it is also a value consistent with numerical simulations. 

The reader should notice that the theoretical value for is related to the ideal random close 
packing; however the states corresponding to this value of ip^ can be reached by local algorithms, like 

^The authors of [52] interpreted their data as showing no evidence for a glass transition, the pressure being a 
diiferentiable function of ^p. However, as recognized in [53], their data are better described by a broken curve showing 
a glass transition around ipg = 0.56. 
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most of the algorithms that were used in the literature, in a time that should diverge exponentially 
with the volume. Some caution should be taken in using the data obtained by numerical simulations. 
The question of which is the value of the density that can be obtained in large, but finite amount 
of time per particle is very interesting and more relevant from a practical point of view: however we 
plan to study it at a later time. 

Note that the result for the mean coordination number z of section 2.5, that gives 2 = 6 at = (/?c 
in = 3, is independent of the particular form chosen for S{(p), and thus is valid for both the HNC 
and CS equations of state. The value z = 6 has been reported in many studies [62, 63, 64, 65, 66]. 

2.6.4 Conclusions 

The replica method of [15, 37] has been succcsfuUy applied to the study of the ideal glass transition 
of Hard Spheres, and in general of potentials such that the pair distribution fimction g(r) shows 
discontinuities, starting from the replicated HNC free energy and expanding it at first order in the 
cage radius VA. 

This result allowed to compute from first principles the configurational entropy of the liquid as well 

as the thermodynamic properties of the glass up to the random close packing density. The computation 
is based on the HNC equation of state, that is known to yield a poor quantitative description of the 
liquid state at high density. Nevertheless, it is found that the qualitative scenario for the ideal glass 
transition that emerges from the replicated HNC free energy is very reasonable. In particular, a 
complexity S ~ 1, a Kauzmann density ipK = 0.582, and a random close packing density ifc = 0.64. 
All these results compare well with numerical simulations. 

Using, on a phcnomenological ground, the Carnahan Starling equation of state instead of the HNC 
equation of state as input for the calculations, it was also possible to compare the results with the 
high-density pressure data of Rintoul and Torquato showing that they are indeed compatible with 
the observation of a real glass transition. 

Moreover, it was found that the mean coordination number in the amorphous packed states is 
z = 2d irrespective of the equation of state used for the liquid, in very good agreement with the result 
of numerical simulations and with theoretical arguments [62, 63, 66, 65]. 

It is worth to note that these results do not prove the existence of a glass transition for the Hard 
Sphere liquid, as they derive from a particular approximation for the molecular liquid free energy (the 
HNC approximation), and, in general, other approximation such as the Percus-Yevick are possible [68]. 



Chapter 3 

Correlation between fragility of the 
liquid and the vibrational 
properties of its glass 



3.1 Introduction 

The identification of the microscopic details that, in a given glass former, determine the temperature 
dependence of the viscosity, and thus the value of the fragility, is a long standing issue in the physics 
of supercooled liquids and glassy state. Large numerical and theoretical effort has been devoted to the 
attempt to relate the fragility to the specific interparticle interactions (e. g. strong glasses are often 
characterized by highly directional covalent bonds, while the fragile one have more or less isotropic 
interactions). The phenomenological relevance of the concept of fragility relies on the correlations 
that have been found between this index and other properties of glass-forming liquids. Examples of 
these correlations are the specific heat jump at Tg (see Eq. (1.7) and [3]), the degree of stretching 
in the non-exponential decay of the correlation functions in the liquid close to Tg [69], the visibility 
of the Boson peak at the glass transition temperature [70] , or the temperature behavior of the shear 
elastic modulus in the supercooled liquid state [71] . Recently a strong correlation between fragility of 
the liquid and vibrational properties of its glass has been found [72]. 

3.1.1 Fragility and number of states 

Recently, the attention has been focused on the possible relation existing between fragility and the 
properties of the (free) energy landscape, more specifically the (free) energy distribution of the minima 
and the properties of the basins of attraction of such minima. A key point is the validity of the Adam- 
Gibbs relation (1.6): 



By using the Adam-Gibbs relation, one could expect to relate fragility to the properties of 5](r), i.e., 
to the distribution of basins in the phase space of the system. For example, many authors proposed 
that fragile systems should have an higher number of states, i.e. a larger complexity, with respect to 
strong ones [1, 73, 74, 75]. 




(3.1) 
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Figure 3.1: From [72]: (Left) The inverse noncrgodicity factor f{Q*,T)~^ for Q* = 2nm~^ and for 
three different substances as a function of T/Tg. In the inset, the wave vector dependence of f{Q, T) is 
shown at fixed temperature T* to demonstrate that f{Q*,T) ~ limg^o f{Q,T). (Right) Correlation 
plot of the fragility and the index a defined in Eq. (3.4). 



However, this possibility is frustrated by the lack of knowledge on the parameter £. Some theories 
attempting to compute summarized in section 1.4.3, appeared only recently-^ and in general the 
theory of the Adam-Gibbs relation is still at an early stage of development. 

Unfortunately, even if a model for T,{T) is chosen, so the total number of states is fixed, one can 
obtain the whole range of experimentally observed fragilities by varying £: fragility is related to T,{T) 
by Eq. (1.7), but the value of Tg depends strongly on £. More specifically, in [76] it was observed that 
for a large class of models for I](T) - where E(T) is a concave function of T that vanishes at a given 
temperature Tk and assumes its maximum Sqo at high temperature ( "Gaussian- like models") - the 
relevant parameter that actually determines the fragility is 

D=7f^- (3.2) 

For example, if 5](T) = Eoo (l — ^) - the form that is commonly used to fit experimental data, see 
Eq. (1.5) and Fig. 1.2 - is substituted in Eq. (3.1) and the fragility is calculated from Eq. (1.2), one 
gets 

^ = 171ogl0i?-i + l . (3.3) 

Thus, fragility appears to be determined by the ratio between £ (measured in units of UbTk) and the 
total number of states 1^00/ ks] it is related to both the distribution of minima (through Soo) and the 
characteristic of the transition path between them (through £). The relation between fragility and 
phase space properties can be even more complicated, in those cases where the function S(T) does 
not belong to the Gaussian class. 



3.1.2 Fragility and vibrational properties of the glass 

Recently a strong correlation between fragility and the vibrational properties of the glass at low 
temperatures has been foimd [72]. The noncrgodicity factor f{k, T) defined in Eq. (1.8) was measured, 

^In particular, the papers [46, 47] appeared after this work was completed so their results were not known at the 
time this calculation was performed. 
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by mean of inelastic X-rays scattering, in the (nonequilibrium) glass phase after a quench from high 
temperature. In Fig. 3.1 the temperature dependence of f{k ~ 0, T) is shown^. It is found that 
f{k 0, T)~^ is approximately linear in T/Tg and an index a is defined as the slope of the curves in 
Fig. 3.1: 

d[.f{k,T)]- 



a{Tg) = lim 



fc-»o d{T/Tg 



(3.4) 

T=0 



The index a has an explicit dependence on Tg (as ^^^^^ ^ — Tg-^). Moreover, it depends on Tg 
also because depending on the value of Tg (i.e. on the experimental time scale) different states are 
selected: in particular, the states that are selected are the equilibrium states at T = Tg, as exactly at 
this value of temperature the system falls out of equilibrium. The order parameter f{k, T) of a given 
state is a measure of the volume of this state in the phase space, and can in principle depend on the 
state in which the sistem is frozen below Tg. In particular, in [72] an expression of a in terms of the 
harmonic vibrational properties of the states (eigenmodes of the disordered structure), was derived: 
and the eigenmodes will depend on the particular structure in which the system is frozen, that is, on 
the equilibrium structure at T = Tg. 

In the right panel of Fig. 3.1 it is shown that the index a is strongly correlated with the fragility 
index niA- This finding implies the existence of a relation between three features of the energy 
landscape: the energy of the minima, the transition paths between them (that together determine 
the fragility) and the Hessian matrix, evaluated at the minima themselves, that fixes the vibrational 
properties. 



3.2 Fragility in mean field ]9-spin models 

As discussed in the first chapter, mean field models such as the disordered p-spin model provide 
an useful framework to understanding many aspects of the glass transition. Using the arguments 
of sections 1.4.1 and 1.4.3 one can relate the quantities appearing in the Adam-Gibbs relation, i.e. 
S(T) and £{T), to the mean field potential V{q,T) that is expected to describe short range models 
at the local level. One can then investigate the p-spin models as solvable models of "glass" , where 
the distribution of minima is "Gaussian-like" as in real structural glasses, and both the vibrational 
properties of the minima and the energy barrier £{T) can be analytically estimated. The p-spin 
models are "Gaussian-like" , in the sense that their complexity - even if the distribution of states is 
not exactly Gaussian - is known to be a concave function of the temperature, that vanishes at Tk and 
assumes its maximum at Td, without any inflection point in between, see [22] and Fig. 1.5, yielding a 
form very similar to Eq. (1.5) for 5](T). 

In this chapter, both the spherical and Ising version of the p-spin model will be investigated, 
in order to check whether one can reproduce the correlation between fragility of the liquid and the 
vibrational properties of its glass found in [72] by studying the geometry of the phase space of these 
models. Moreover the question of the existence of a correlation between fragility and number of states 
[73, 74, 75] will be addressed. 

The mean field models will be considered as models for the local properties of a short range glass, as 
indicated by the arguments discussed in sections 1.4.1 and 1.4.3. Then, the existence of the dynamical 
transition will be ignored, being an artifact of mean field, and it will be assumed that it is possible to 
equilibrate the system below Td with a relaxation time following the Adam-Gibbs relation (3.1) with 

^In [72] the wave vector was indicated by Q instead of k, so this notation is used in Fig. 3.1 
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E and E determined by the moan field potential T). As will be clarified below, the fragility of 
the models can be varied by varying the parameter p. 



3.2.1 Definition of the relevant observables 

It is useful to summarize the definition of all the quantities that will be computed, that are listed 
below: 

Tk Thcrmodynamical transition temperature 

Tg Glass transition temperature 

Ti Dynamical transition temperature 

S(Tg) Complexity at Tg 

m{Tg) Fragility 

a{Tg) "Volume" of the equilibrium states at Tg 
£{Tg) "Barrier height" at Tg 

Setting ks — 1, all the above quantities are either dimensionless or have the dimension of an energy; 
in the p-spin model -as usual in classical spin models- a natural energy scale J appears as the strenght 
of the couplings between spins. Thus, if one additionally sets J = 1, all the quantities become 
dimensionless. 



Temperatures 

From the two replica potential V{q^ T) discussed in section 1.3.2 the complexity TYi{T) = V{qmin{T), T)— 
V{0, T) and the barrier height £{T) = V{qmax{T),T) — V{qmin{T), T) are extracted as functions of the 
temperature. Then, the thermodynamical transition temperature Tk is defined as the temperature 
where the complexity vanishes: Y,{Tk) = 0, and the value of V at the secondary minimum becomes 
equal to zero (see Fig. 1.6). The dynamical transition temperature T^ is the temperature at which 
the metastable minimum first appears, so it is defined by £{T) = 0. 

Then, an Adam-Gibbs like relation in which £{T) plays the role of the energy barrier and TS(T) 
of the configurational entropy is considered^. Starting from the Adam-Gibbs relation (3.1) one defines 
Tg by T{Tg)/T^ = const, or, equivalently, by 

The value of the constant C determines the value of Tg. It is arbitrary because proportionality factors 
have always been neglected, so it will be fixed in order to obtain reasonable values for the fragility, 
m^i/lT ^ 1 10, as observed in experiments, see Fig. 3.1. It will turn out that the analysis is 
not strictly dependent on the value of Tg (and of C), the behavior of the various quantities at Tg 
being representative, as will be shown, of a general trend observed at all temperatures T e [TK,Td] 
by varying p. Different choices of the constant C change only quantitatively the results, while the 
qualitative picture stays the same. 



Complexity, barrier heights and fragility 

Given a definition of Tg, the complexity at Tg is simply S(Tg) and the barrier height £{Tg): clearly, 
these two quantities are related by Eq. (3.5). Knowing the complexity as a function of the temperature, 

^The argument of section 1.4.3 predict an Adam-Gibbs relation where (TS)^ enters in the denominator and f 2 in 
the numerator. However, the exponents will be neglected as their robustness is still a matter of debate. 
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the fragility can be defined as in Eq. (1.7). To simplify the notations, the factor 17 entering Eq. (1.7) 
will be neglected in the following and the fragility defined as: 

rn(r,) = l+T,|^. (3.6) 

The latter definition is very useful in a mean field context as - once a definition of Tg has been chosen 

- it involves only the complexity, that is a well-defined quantity in mean field models. It is equivalent 
to the usual Angell definition of fragility if rj^ docs not depend strongly on the material, and the 
Adam-Gibbs relation is assumed to be valid [76]. This definition of fragility has been shown to be 
correlated to the fragility defined from the relaxation time using experimental data in [3] . 

Volume of the states 

The index a defined in [72] can be replaced by other equivalent - equivalent meaning positively 
correlated - definitions. An useful equivalent definition of a is 

As one can easily check observing Fig. 3.1, this definition is equivalent to Eq. 3.4 if the curves of 
f{k,T) as function of T for different materials do not intersect. 

The quantity f{k,T) (in the low-fc limit) can be identified in spin models with the self-overlap of 
the states as discussed in section 1.1.6. Thus, one can define 

a(r,) = 1 - q{Tg) , (3.8) 

where q{Tg) is the self-overlap of the equilibrium states at Tg, i.e., the value of q where V{q,T) has 
the secondary minimum at T = Tg (sec Fig. 1.6). 

As the self-overlap of the states is related to their volume in phase space (high overlap correspond- 
ing to small states), a small value of a corresponds to small- volume states, while a big value of a 
corresponds to large-volume states. In this sense, a{Tg) will be called "volume of the equilibrium 
states at Tg" . Note that a similar identification has been discussed in [72]: indeed, from Eq. (7) of 
[72]^ one can see that a is related to the curvatures of the minima of the potential (in the harmonic 
approximation), and that small curvatures (large volume) correspond to large a, while high curvatures 
(small volume) correspond to small a. This is consistent with the equivalence of the definition of a 
given in [72] and the one adopted here. 

Summary of the definitions 

To conclude this section, it is useful to give a short summary of all the definition discussed above. 
Calling qmin{T) the value of q where V{q,T) has the secondary minimum, and qmax{T) the value of 
q where V{q, T) has a maximum, the definitions are: 

E(r) = [F(g™„(r),T)-l-(0,r)]/T 
£{T) = V{qma.{T),T)-V{q^UT),T) 



Tk 

Td 



E{Tk) = 



8{Td) = 



m{Tg) ^ l + Tg%g^ 

<^{Tg) = 1 - <lmin{Tg) 



*Due to a misprint in Eq.(7) of [72] the power —1 has to be disregarded. 
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Figure 3.2: (Left) Thermodynamic transition temperature Tk, glass transition temperature Tg and 
dynamical transition temperature Td, and (right) fragility m^Tg), configurational entropy ^{Tg), "vol- 
ume" of the equilibrium states a{Tg) and barrier height S{Tg) for the p-spin spherical model as a 
function of p — 2. 



The constant C has to be chosen in order for the fragility to be in the experimentally observed range, 
m - 1 10. 



3.2.2 Spherical p-spin model 

The full expression for V{q, T) in the p-spin spherical model has been computed in [36, 39]. However, 
a simplified expression can be used when the value of V{q^ T) on its stationary points is considered: 

Viq, T) - ^^(r) = -jq'~\ log(l - 9) - ^ ■ (3.9) 

This function has been shown in section 1.3.3 to coincide with the correct V{q,T) on each stationary 
point of V{q,T). If one is interested only in the value of V{q,T) on its stationary points, the use of 
the correct V{q, T) calculated in [36, 39] or of the one given by Eq. (3.9) gives exactly the same result. 

Note that, while the model is defined only for integer p, Eq. (3.9) makes sense also for real p; 
therefore the behavior of the different quantities for any real p > 2 can be investigated. In particular, 
the p — > 2 limit is interesting being related to a diverging fragility {T^ Tx) and to the discontinuous 
Irsb transition becoming a continuous one. 



Temperatures 

From Eq. (3.9) one can compute the three temperatures Tk, Tg and Td as functions of p. Their 
behavior is reported in Fig. 3.2. For p ^ 2, the difference between Tk and Tg is very small, therefore 
the system is very fragile; for p — > oo the Kauzmann temperature approaches zero (as 1/%/Iogp), while 
the glass transition temperature remains finite. The system therefore becomes stronger and stronger 
on increasing p. 



Complexity and fragility 

The same observation can be made more quantitative by considering an "Angell plot" for the com- 
plexity [3]: in Fig. 3.3 the complexity S(T) is plotted as a function of the temperature, for different 
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Figure 3.3: Scaled plot of the complexity, E(Tg)/S(T), as a function of Tg/T for the p-spin spherical 
model at different values of p. The figure has to be compared with Fig. 1.3; in both figures fragility 
is the slope of the curves in Tg/T — 1. The system becomes stronger on increasing p. 

values of p. The choice of the particular scaling that appears in Fig. 3.3 has been made in order to 
make a close correspondence with Fig. 1.3, extracted from [3]. The curves for different values of p 
are ordered from bottom to top. The same behavior is observed in glass formers of different fragility. 
Indeed, the index of fragility defined in Eq. (3.6) is exactly one plus the slope in Tg/T = 1 of the 
curves in Fig. 3.3: 

n.iTg) = l + Tgm^^l+'Mi^ 



nTg) d[Tg/T] 



(3.10) 

T=T„ 



The fragility index m is shown in Fig. 3.2 as a function of p. It is a decreasing function of p. Its 
values are in the range observed for experimental system due to the (arbitrary) choice of the constant 
C appearing in Eq. (3.5), C = 0.1. In Fig. 3.2 'S{Tg) is also reported as a function of p. It is an 
increasing function of p, that diverges as logp for p oo: thus, the number of states in this system 
is a decreasing function of the fragility^. 

Barrier heights and volume of the states 

In Fig. 3.2 the barrier height £{Tg) is also reported as a function of p, together with the index 
a{Tg) = 1 — q{Tg) that was called "volume" of the equilibrium states at Tg. In this model the states 
become smaller on increasing p, while the barriers separating them increase. The correlations between 
these quantities will be discussed in section 3.3, where a geometric description of the evolution of the 
phase space of this model at different p will be proposed, that relates fragility to geometric properties 
of the phase space. 

3.2.3 Ising p-spin model 

The Ising p-spin model is another popular model for the study of the glass transition [10, 17, 77]. Its 
Hamiltonian is given by Eq. (1.10), where the variables Ui are Ising spins, ct; = ±1, and the spherical 

®A review of some results on the correlation between fragility and number of states can be found in [76]. 



52 



CHAPTER 3. CORRELATION BETWEEN FRAGILITY AND VIBRATIONAL PROPERTIES 




Figure 3.4: (Left) Thermodynamic transition temperature Tk, glass transition temperature Tg and 
dynamical transition temperature Td and (right) fragility m(Tg), configurational entropy E(Tg), "vol- 
ume" of the equilibrium states a{Tg) and barrier height S{Tg) for the p-spin Ising model as a function 
of 2. 

constraint is absent. For the Ising p-spin model, the two-replica potential V{q,T) is given by 

Vi,, T) - FiT) = p^-^,^ + pla^-^ - /P.cosy.)logcosh(A.) 

4 4 J 2?zcosh(A2;) 

where Vz = exp(-z2/2) dz, and = /J^H^p-i. 

Note that the total number of states in the Ising p-spin model cannot be greater than 2^ (the 
total number of configurations), and hence S(T) < log 2, while in the spherical model 5^(T'g) diverges 
as logp for p ^ oo, as previously discussed. 

Temperatures 

The first consequence of this difference is observed when studying the transition temperatures as 
functions of p (see Fig. 3.4). Indeed, as in the spherical model, Tk ~ Tg for p 2, and Tg ^ Tk 
for p oo. But, in this model, Tk tends to a finite value at large p, while Tg and Td diverge. This 
behavior can be understood recalling that for a "Gaussian-like" model one has Tk ~ 1/ Eqo 
being the total number of states, i.e. the maximum of S(r) [76]. 

Complexity and geometric properties of the phase space 

The "Angell plot" for the complexity of the Ising p-spin model looks very similar to the one of the 
spherical model. Fig. 3.3, so it is not useful to report it. 

Having fixed an appropriate value for the constant C in Eq. (3.5) (C = 0.02, different from the 
value chosen in the spherical case) , the behavior of the fragility as a function of p is also very similar 
to the one of the spherical model. The same behavior is found for the other quantities under study, 
as one can deduce from a comparison of Fig. 3.4 and Fig. 3.2, the main difference being the discussed 
behavior of 5](Tg) at large p. 
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Figure 3.5: Fragility versus a for the spherical and Ising p-spin models. The curve is very similar for 
the two models, and is consistent with the correlation found in [72], see Fig. 3.1. The linear correlation 
is reproduced for a < 0.4. 

Vibrational properties and volume of the states 

Another relevant difference between the spherical and the Ising model is that, in the latter, harmonic 
vibrations are not present (the variables being discrete): we have q(T) —^ 1 exponentially for T ~ 0, 
and the definition of a via Eq. (3.4) gives a = for all p. However, the definition given in Eq. (3.8) 
and used in these calculations gives a reasonable result also in absence of harmonic vibrations. 



3.3 Correlations between different properties of the phase space 

In this section the correlations between the quantities under study will be investigated, trying to relate 
fragility to the phase space geometry. The results will be compared with the general consideration 
of [76] , and with the experimental results of [72] . 

3.3.1 Fragility and volume of the states 

In [72] it has been established that fragility is positively correlated with the index a defined in 
section 3.2.1. In other words, fragile systems have large basins while strong systems have small basins. 
In Fig. 3.5 the fragility m is plotted as a function of a parametrically in p for the investigated systems. 
The curve m{a) is very similar for the two models - remember that the only adjustable parameter 
is the constant C in Eq. (3.5). By comparison with Fig. 3.1, one can conclude that the model has a 
behavior similar to the one of real systems. Surprisingly, also the linear correlation between m and a 
is reproduced for a < 0.4. Thus, mean field p-spin models are able to describe the relation between 
fragility and the volume of the basins visited around Tg found in [72] . 
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Figure 3.6: Total number of states (represented by the complexity at Tg) as a function of the fragility 
m for the p-spin models. 

3.3.2 Fragility, barrier heights and number of states 

It has been conjectured that fragile systems have a larger number of states than strong ones, even if 
the total number of states is not an experimentally accessible quantity and numerical simulations give 
contradictory results [73, 74, 75]. However, in the models considered here the behavior is exactly the 
opposite. In Fig. 3.6 S(T'g) is reported as a function of the fragility: the total number of states is a 
decreasing function of the fragility. 

This point was discussed in detail in [76] , where the possibility of correlating fragility with the total 
number of states for general models of S(r) was discussed, assuming the validity of the Adam-Gibbs 
relation, Eq. (3.1). The conclusion was that the knowledge of the distribution of states is not enough 
to determine the fragility. Indeed, the relevant parameter, for a general "Gaussian-like" distribution 
of states, is 



barrier height £ is a T-dependent quantity, while in the Adam-Gibbs relation it is usually assumed 
to be a constant. However, the Adam-Gibbs relation has been tested around Tg, therefore, to a good 
approximation, one can fix £" to be a constant equal to its T = Tg value. The parameter D is inversely 
proportional to the fragility m: therefore m ^ and fragility turns out not to be simply correlated 
to the total number of states. If the "barrier heights" grow faster than the total number of states, 
fragility can be a decreasing function of S: this is indeed the case in the considered models. Indeed, 
from Fig. 3.2 and Fig. 3.4, one observes that the barrier height is an increasing function of p. Using 
Eq. (3.5), Eq. (3.12) can be written as 



Therefore, from Fig. 3.2 and Fig. 3.4, D is an increasing function of p that diverges for p oo, as the 
ratio Tg/TK increase on increasing p for both models. Thus, in the considered models the height of 
the barriers (in units of Tk) increases faster than the total number of states. This explains why one 





(3.13) 
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Figure 3.7: Sketch of the evolution with p of the p-spin free energy landscape: at small p there is a 
small number of states of large volume separated by low barriers; at high p there is a large number of 
states of small volume separated by high barriers. The height of the barriers increase faster than the 
number of states: thus, fragility is a decreasing function of p. 

observes an inverse correlation between fragility and the total number of states, as discussed above 
and in [76]. 

3.3.3 A geometric picture of the phase space 

The information obtained in the previous sections can be collected in a geometric picture of the 
evolution with p of the p-spin model free energy landscape. Indeed, on increasing p: 

i) The total number of states increases. 

a) The volume of the states decreases (a decreases). 

in) The height of the barriers between states increases. 

Thus, we get the picture of a landscape where, on increasing p, a great number of small states with 
very high curvatures and separated by very high barriers appear: a sketch of this evolution is given 
in Fig. 3.7. The behavior of the fragility in this situation is related to the behavior of the ratio 
between number of states and height of the barriers between them: in these models, it turns out that 
£ increase faster than S, and the fragility is a decreasing function of p. 

This behavior is consistent with the fact that fragility turns out to be positively correlated with 
the "volume" of the states as measured by a. Indeed, if, on the contrary, the barrier height grew 
slower than the total number of states (equivalently, if m would be positively correlated with the total 
number of states), there should be also an inverse correlation between m and a, in disagreement with 
what is experimentally observed. 

In the p — > 2 limit, where the fragility becomes infinite, the second derivative with respect to q 
of the potential V{q,T) calculated in g = and T = Tk = Tj, vanishes (sec Fig. 1.6) and the so- 
called spin glass susceptibility diverges at the critical temperature. In other words when the fragility 
becomes infinite soft modes appear at the critical temperature supporting the previously presented 
physical picture. 

Note that the outlined picture is valid for "Gaussian-like" models, i.e., models where the complexity 
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is a concave function of the temperature that vanishes at Tk without any inflection point. These 
models seem to describe correctly the distribution of basins in real systems only for relatively high 
fragilities. The behavior of the complexity (or configurational entropy, or excess entropy) as a function 
of temperature for very strong systems is still an open problem, see e.g. [78, 79] ; our discussion may 
not apply to these systems. 

The main prediction of this analysis is that the total number of states Sqo and the Adam-Gibbs 
barrier £ should both be decreasing functions of the fragility. This prediction disagrees with the 
statement of [73, 74, 75] that fragile systems should have an higher number of states with respect to 
strong ones. A critical analysis of this works can be found in [76] . Unfortunately, existing data are 
not sufficient to strictly test this prediction; the excess entropy is available only for few experimental 
systems, and numerical simulations are performed in a temperature range where the fragility of the 
investigated systems is approximately the same. Hopefully this predictions will be tested in the future. 



Part II 

Nonequilibrium 
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Chapter 4 



Nonequilibrium stationary states 
and the fluctuation theorem 



4.1 Introduction 

4.1.1 A critical review of the ergo die hypothesis 

The statistical mechanics of equilibrium states can be constructed starting from the ergodic hypothesis 
of Boltzmann, see e.g. [30] for a modern review. An equilibrium system is, for instance, a system of 
N classical particles enclosed in a volume V which interact between themselves and with the wall of 
the container only by conservative forces. The phase space of the system can be divided in suitable 
cells^ A, such that the dynamics can be represented as a discrete-time map SA = A' acting on the 
cells. Then, the ergodic hypothesis is the assumption that /S is a one-cycle permutation of the cells 
with constant energy (because the energy is kept constant by the time evolution). This means that 
all the cells are visited sequentially: and if one considers an observable F{A), the time average 



starting from any initial condition A such that U{A) = U, does not depend on the initial condition 
and is simply given by the flat average over the cells with energy U, 



where Af{U, V) is the total number of such cells. Starting from the ergodic hypothesis Boltzmann 
was able to prove that, if one defines the observables T (temperature), U (internal energy), and P 
(pressure) in terms of the average kinetic energy, potential energy, and momentum transfer to the 
container walls respectively, a function S{U, V) (entropy) exists such that 



The function S{U,V), in the construction of Boltzmann, is S{U,V) = kBiogAf{U,V). The ergodic 
hypothesis says that the statistical measure describing the equilibrium macroscopic state on the phase 
^See [30] for a very deep discussion on how these cells have to be constructed. 




(4.1) 




(4.2) 



dS = 



dU + PdV 

T 



(4.3) 
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space of the system is simply the flat measure on the surface of constant total energy U. The ensemble 
of these measures, obtained by varying the values of the external parameters U, V, is called the 
microcanonical ensemble. Then one can show that different ensembles of measures can be defined, 
and that they are equivalent, in the sense that they give rise to the same macroscopic relations between 
obscrvablcs and in particular that Eq. (4.3) holds for all of them. 

Despite this success, the ergodic hypothesis was criticized, because it seemed impossible to derive 
the irreversible laws of thermodynamics from the microscopic reversible equations of motion. Indeed, 
if the dynamics 5 is a one-cycle permutation of the cells, after a given recurrence time the system 
must come back to the cell in which it was prepared at the initial time. The observation of Boltzmann 
was that this recurrence time, for a macroscopic system of ^ lO^'' particles, could be estimated 
to be essentially infinite on any reasonable time scale, so that reversibility could not be observed for 
macroscopic systems. 

However, this argument seems to make the ergodic hypothesis meaningless: if the time needed 
for the system to visit all the cells is much larger than any experimentally accessible time scale, the 
replacement of the average over the time evolution with the flat average over the cells is unjustified. 
Boltzmann realized this difficulty [30] and solved it observing that, for a macroscopic system, the 
thermodynamically interesting observables are essentially constant on phase space, thanks to the law 
of large numbers. Then, even if the system visits only a small portion of its phase space on the 
experimental time scale, the replacement of the time average with a flat average on phase space gives 
the correct result. 

Thus, the ergodic hypothesis alone is not a justification of the thermodynamics. However it 
correctly suggests that the averages of the interesting observables can be computed using the flat 
measure on phase space, provided that the size of the system is large. It is even not important to 
prove that a given physical system is ergodic, and it is likely that many of the models which are 
commonly used to describe physical systems are not ergodic. The ergodic hypothesis is relevant 
because it allows to identify the correct measure describing the macroscopic equilibrium states on the 
microscopic scale. 

4.1.2 Nonequilibrium states and the chaotic hypothesis 

One could ask if a similar construction can be repeated in the case of a stationary nonequilibrium 
system. For instance one can think to a system of N interacting particles in d dimensions, enclosed 
in a container of volume V, subjected to nonconservative forces and kept in a stationary state by 
a reversible mechanical thermostat. It will be defined by a differential equation x = Xe{x) where 
X = (^) q) € R^'^^ = M {phase space) and 

mq = m+g^{q)-0Eig,g) (4-4) 

where m, is the mass of the particles, f(q) describes the internal (conservative) forces between the 
particles (and between the particles and the walls of the container) and g ^{<l) represents the noncon- 
servative "external" force acting on the system, which is assumed to depend smoothly on a parameter 
E (e.g. the amplitude of the electric field). Finally, 0^{q,q) is a mechanical force that prevents the 
system from acquiring energy indefinitely: this is why it is called a mechanical therm,ostat. Systems 
belonging to this class are frequently used as microscopic models to describe nonequilibrium stationary 
states induced by the application of a driving force (temperature or velocity gradients, electric fields, 
etc.) on a fluid system in contact with a thermal bath [80, 81]. The problem of which is the measure 
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describing the stationary states of such a system is still matter of debate, but important progress have 
been achieved in recent times. They will be discussed in the rest of this chapter. 

A first difficulty one has to face is that, for nonequilibrium stationary states, a well-established 
macroscopic theory similar to equilibrium thermodynamics does not exist [82]. Prom a microscopic 
point of view, the main difficulty is that the equation of motion (4.4) yields a phase space contraction 
rate 



such that -^dx = —a{x)dx, which has positive average [83], i.e. if StX is the solution of Eq. (4.4) with 
initial datum x, for almost all x w.r.t. the volume dx, one has 



This means that phase space volume is not conserved by the time evolution, so the invariant measure 
cannot be the flat measure on phase space, and cannot even admit a density, i.e. be of the form 
li{dx) — ii{x)dx: it will be concentrated on a set of zero volume in phase space. Also, this means that 
the description of the system in terms of cells A and the hypothesis that the dynamics is a simple 
one-cycle permutation cannot hold for nonequilibrium systems. Still a description in term of cells is 
possible but it does not lead to a satisfactory notion of "entropy" [84]. 

A very important step towards the construction of a statistical mechanics of nonequilibrium sta- 
tionary states was the explicit construction of the invariant measure for a class of smooth chaotic 
dynamical systems, called Anosov systems [30, 85, 86, 87, 88, 89, 90, 91]. For these systems it was 
proved that almost all points w.r.t. the volume measure^ evolve so that all smooth observables have 
a well defined average equal to the integral over the invariant measure, i.e. for all smooth F{x) 



The measure iJ,+ {dx) is called Sinai-Ruelle-Bowen (SRB) distribution. In particular this holds for 
the phase space contraction rate a{x) and the relation a+ > 0, see Eq. (4.6), was proved for these 
systems [83]. 

Anosov systems are paradigms of chaotic systems: and even if essentially none of the physically 
interesting systems could be proved to be Anosov, a chaotic hypothesis was proposed [92, 93], which 
states that nevertheless one can assume that chaotic motions (in the sense of motions with at least one 
positive Lyapunov exponent) exhibit some average properties of truly Anosov systems. In particular, 
it should be possible to compute the averages of the physically interesting observables using the SRB 
distribution. 

This hypothesis is a natural generalization of the ergodic hypothesis, as the SRB distribution 
reduces to the flat distribution in the equilibrium case where = 0. Similarly to the ergodic 
hypothesis, the chaotic hypothesis simply suggests that the invariant measure is the SRB measure, even 
if the system is not an Anosov system. But this allows to make some predictions on the macroscopic 
properties of systems like the one described by Eq. (4.4), similarly to what has been done by Boltzmann 
by proving that the ergodic hypothesis implies the validity of Eq. (4.3). 

^This is very important as it means that the initial datum has to be randomly extracted from the flat measure on 
phase space, i.e. the system has to be prepared at equilibrium and then let evolve under the action of the nonconservative 
forces. 



a{x) = —divXE{x) 



(4.5) 




(4.6) 




(4.7) 
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4.1.3 The fluctuation theorem 

An interesting prediction of the chaotic hypothesis is the vahdity of a relation that concerns the large 
deviations of the phase space contraction rate, and that has been named fluctuation relation. The 
validity of this relation for a reversible Anosov map S was proved {fluctuation theorem) in [92, 93]. 
Reversibility means that there is a metric-preserving map I on the phase space M such that IS = S~^I 
and is a key hypothesis for the validity of the fluctuation relation. For a map S the phase space 
contraction rate is defined as 

cr(a;) = -log|dct9S'(x)| , (4.8) 

and it is a smooth function on M. As discussed above the average of a{x) exists and is fT+ > 0. If 
cr+ > 0, let: 

p{x) = —J2ct{S'x). (4.9) 

The function p{x) has average {p) = 1 and distribution ttt (dp) such that 

nr{{p e A}) = e^'"'''=''^^'^~(f)+°(^) , (4.10) 

where the correction at the exponent is o(r) w.r.t. r as r — > oo, and the function Coo{p) is analytic 
and convex in p. The fluctuation relation then reads: 

Coo (p) = Coo i-p) + P(T+ for an \p\ < p* , (4.11) 

where oo > p* > 1 is a suitable (model dependent) constant that, in general, is different from the 
maximum over r and x of p(x), and is defined by Coo(p) = — oo for \p\ > p* . 

The interesting fact is that the fluctuation relation has no free parameters: thus the simplest and 
more stringent check of the applicability of the chaotic hypothesis is a check of the fluctuation relation. 
Of course even if the check has a positive K^sult this will not "prove" the hypothesis hut it will at k^ast 
add confidence to it. This test has been performed in a number of cases'' with positive result, by mean 
of numerical simulations [94, 95, 96, 97, 98, 99, 100, 101, 102] and experiments [103, 104, 105, 106]. 

In the following, after a brief review of the procedure that allows to construct the SRB measure 
for Anosov systems, the physical implications of the chaotic hypothesis will be discussed. 



4.2 Sinai— Ruelle—Bowen (SRB) measures 
4.2.1 Anosov systems 

Anosov systems arc paradigms of chaotic systems. They are defined as follows [91]. Given a compact, 
smooth and bomidaryless manifold M (phase space), a map 5* G C^(M) is an Anosov map if: 

(1) For all a; e M the tangent plane to M in x, T^, admits a decomposition =T^ (B T^, such that 

(2) the planes TJ'" vary continuously w.r.t. x, i.e. the vectors defining them are continuous functions 
of x; 

(3) the angle between and T", defined as the minimum angle between a vector in and a vector 

in T", is not vanishing; 

(4-) defining dS the linearization matrix of S in x, i.e. S{x + ev) = S{x) -\- e dS{x) ■ v + O(e^), x € M, 
u e Ta,, e e M small, the planes T^*'" are conserved under 5, i.e. if t; e T^'", then dS{x) ■ v e Tg'^; 



'Historically the fluctuation relation was flrst discovered numerically in [94], and this gave the motivation for [92, 93]. 
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Figure 4.1: A pictorial representation of an Anosov system. In the vicinity of a point x G M it is 
possible to draw two families of manifolds Af^'". The manifolds passing through x are the stable 
and unstable manifolds of x, M*'". Under the action of S, the manifolds M|'" are mapped into the 
manifolds Mg'^ passing through Sx. A point y G is mapped into a point Sy whose distance from 
Sx is larger by a factor A, while a point z G is mapped into a point Sz which is closer to Sx 
by the same factor A. 



(5) for all X e M and for all v G one has \dS{x)''v\skx < A~''C\v\x, while for all v G one has 
\dS{x)~''v\s-k^ < A~''C\v\x, I • \x being the norm on T^, for some constants C, A > 0; 

( 6) there is a point x which has a dense orbit in M. 

The hypotheses above imply that it is possible to identify two families of smooth manifolds M**'" in 
M, such that TJ'" arc the tangent plane to M*'" in x, and such that points on tend to converge 
exponentially while points on M" tend to diverge exponentially under the action of S. 
This means that for each x G M there is a stable manifold M| such that for all y G M| one 
has d{S^x,S^y) < K~^Cd{x,y), and an unstable manifold such that for all y G one has 
d{S~''x,S~^y) < hr^Cd{x,y), where d{x,y) is the distance on M, see Fig. 4.1. 



4.2.2 Mcirkov pcirtitions 

To each point x G M one can associate a sequence e — (ei)i^_oo of finitely many digits e = 1, . . . , /C 
in the following way: one partitions the phase space in K. sets Mi, • • • , Af^, such that U^^^Mfe = M 
and Mi n Mj = for all i ^ j. Then one sets Sq = ko ii x G M^^, £\ = k\ if Sx G M^^, e_i = /c_i if 
S~^x G Mk_-^, and so on, i.e. £i is defined by S^x G M^.. 

It is clear that in such a representation the dynamics becomes simply the left shift, i.e. if s{x) 
represents x then Sx is represented by the sequence e shifted to the left by one unit. 

To each x G M a. single sequence e is associated, apart from that points x such that for some i 
the point S^x falls on the boundaries of the sets M).. In these cases one has an ambiguity: but it is 
possible to show [91] that the number of possible sequences that are associated to a given point x is 
finite, and that only a set of zero volume has more than one associated sequence*. 

The key observation is that not all sequences are possible: for example, the points in the set Mi 
will evolve under the action of 5* but in a single step they will not reach all the others M^. Thus, the 
symbol 1 in the sequence e can be followed only by the symbols corresponding to the sets such that 

''This is essentially the same ambiguity that one has when writing rational numbers as reals: for example 1 can also 
be written as 0.9. It is clear that the ambiguity can be solved simply by choosing to write 1 and not 0.9 everywhere. 
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SMi n Mi ^ 0. This can be expressed by a compatibility matrix Tij which is 1 if SMi n Mj ^ and 
otherwise. Only the sequences e such that Oi^-oo ^ei,ei+i ^ correspond to points x G M. But this is 

(2) 

not enough: a similar condition is needed also for triples of symbols, so one must define a matrix T^^. 
that is 1 if there is a point x € Mi such that Sx G Mj and S'^x G Mk and otherwise, and consider 
only sequences such that Hi^-oo 7^ 0; so on. It is clear that the full knowledge of 

the compatibility matrices T^") is completely equivalent to the full solution of the dynamics (as one 
will be able to reconstruct all the trajectories), so it is a very difficult problem even for very simple 
systems. 

A very remarkable consequence of the assumptions defining Anosov systems is, [85, 86, 87, 91, 92, 
93, 107], that one can find a partition Mi, ■ ■ ■ , Mfc (Markov partition), such that the sequences e are 
subject only to the nearest-neighbors restriction, namely Hi^-oo ^£i,£i+i = 1, as one can prove that 
^ijfe = TijTjk and so on. Moreover, one can prove, from assumption (6) above, that {T^)ij > for 
some N > and all i,j {mixing condition). 



4.2.3 Observables and the SRB measure 
Observables 

Smooth observables on phase space can be represented by short range potentials: in the case of the 
observable (7 (x) = — log| det9S'(a;)| this means that there are translationally invariant iunctions s{ex), 
where X is an interval X = [a, . . . , a + 2n + 1) and = {sa, ■ ■ ■ , £a+2n+i), which are exponentially 
decaying on time scale (i.e. |s(ej!f)| < Ce^*^" for some C,k> 0), such that 

a{x)=s{eix)), s{e) = Y,s{ex) , (4.12) 

XoO 

where the sum is over the intervals X centered at the origin (noted by XoO). What is important 
is that the dependence of the function s{e) on the symbols which are far apart from the origin is 

exponentially small in the distance from the origin. 

Other important smooth observables are the expansion and contraction rates L± (x) , defined as 
the logarithm of the determinant of the matrix dS{x) restricted to the unstable (stable) manifold: 

L+{x) =log\dctdS{x)u\ , ^^^^^ 

(4.13) 

L-{x) = -log|deta5'(3;),| . 

L-i- (x) is the sum of all the positive Lyapunov exponents in x, while i_ is minus the sum of all negative 
Lyapunov exponents^ in x. They are also expressible via an exponentially decaying potential $±: 

L±{x) = A±(£(x)), A±(e) = ^ $±(£^) . (4.14) 

XoO 

Representation of the volume measure 

A truncated compatible sequence (e_T, • • • , £t) represents the sets of all points that share the same 
dynamical history in the time interval [— T, T] and have different histories outside. By the smoothness 
properties of Anosov systems this set defines a parallelepiped At C M. The volume of At is given 
by [91] 



VoI(At) oc exp 



T-l -1 

i=0 i=-T 



(4.15) 



^Note that these are local Lyapunov exponents that depend on the metric, at variance to the usual Lyapunov 
exponents that are obtained in the limit t — > oo and do not depend on the metric used. 
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where T is the translation to the left by one unit. i?(e) is the sum of boundary terms that decay 
exponentially around i = and around i = —T, T. 

The average of a given smooth observable F in stationary state can be defined extracting an initial 
datum with respect to the volume measure and then computing F{S*x) for t ^ oo. If the system 
reaches a stationary state, the average over the volume measure w.r.t. initial data is equivalent to 
the average over the SRB measure describing the stationary state. Then one has, if !F{e) is the short 
range function representing F: 

y g[s(e)-i:LV A+(r'£)-i:ri-T A-(r-e)] j7/-ft^\ 
{F),= lim (F(S*x)) = lim lim =^ 5^-^ . -p"^ • (4-16) 

Representation of the SRB distribution 

The function ^(T*£), for large t, depends strongly on the symbols around St and has a very small 
dependence on the symbols Ej for i < 0. And as the functions B and A_ appearing in the exponent 
are instead peaked around the symbols Si for i < 0, one can write, defining = {si)^!^ and s_ = 

{^i)i=-oo' 

e[Bfe)-E,-i-TA-(^'£)]^^ e[-T.JJo^+C^'^)]jr^T*^) 
{F),r^ lim lim — — =± = , (4.17) 

so that the terms containing B and A_ factorizc and one finally gets, with some simple changes of 
variable in order to center in the origin the sequence appearing in the argument of J-': 

(F) , = lim =^ ; . (4.18) 

The interpretation of the above expression is the following. Given a (large) T, one can consider again 

the sets At of points which share the same history in [— T, T]. The volume of At was given by 
Eq. (4.15). The total probability of the set At w.r.t. the SRB distribution describing the stationary 
state is instead given by 



/i+(AT) ex. exp 



T-1 



exp 



T-1 



i=-T 



(4.19) 



where the sequence e has to be completed (rather arbitrarily) to an infinite compatible sequence by 

continuing e to the right with a sequence and to the left with a sequence into (e<,e, £>) so 
that depends only on the symbol e-T and depends only on the symbol et- see [85, 90, 91]. 
Equivalently, x G At is the point represented by (£<,£,£>)■ Clearly, by sending T ^ oo Eq. (4.19) 
becomes exact. 

Remetrks 

(1) The SRB distribution, represented as a distribution over the (compatible) symbolic sequences e, 
is a Gibbs distribution for the short range potential $+ = (^+(ex)) defined in Eq. (4.14), i.e. 

{F),rb= lim =^ ^ , , (4.20) 
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where At = {—T, . . . , T) C the sums extend over compatible configurations e = (e-t, • • • , et) (i-e- 
with n^I-^T ^£i,ei+i = 1)> ^i.s) is an arbitrary smooth observable defined on phase space regarded 
as a function on the symbolic sequences. This representation is equivalent to Eq. (4.18) or (4.19). 

(2) The reduction of the problem of studying the SRB distribution to that of a Gibbs distribution for a 
one dimensional chain with short range interaction (this is the physical interpretation of Eq. (4.20)) is 
surprising and generates the possibility of studying more quantitatively at least some of the problems 
of nonequilibrium statistical mechanics outside the domain of nonequilibrium thermodynamics. 

(3) The SRB distribution, as expressed by Eq. (4.19), is not absolutely continuous w.r.t. volume, 
as expected. Indeed, Eq. (4.19) is not proportional to the volume of Ay, which is instead given by 
Eq. (4.15). The factor relating the two expressions is the exponential of a sum of Lyapunov exponents 
that becomes singular in the limit T ^ oo. 

(4-) The SRB measure of a set centered around a point x depends on the whole dynamical history of 
x: indeed, it is the exponential of the sum of the positive Lyapunov exponents along the trajectory 
of X in [— T, T], T ^ oo. This is very diff'erent to what happens in equilibrium where the measure of 
a set is simply its volume, possibly multiplied by some weight, e.g. exp{— 13V {x)) . In this sense it is 
said that nonequilibrium ensembles are dynamical [92, 93]. 



4.3 The fluctuation relation 

The fiuctuation relation is a symmetry property of the probability distribution function (pdf) of a 
quantity cr that will be defined below and coincides with the phase space contraction rate in Anosov 
systems. 

Consider a dynamical system, deterministic or stochastic, and the space of its trajectories x{t). If 
cr+ = {(j{t)) > 0, one can define a variable p as in Eq. (4.9): 

rr/2 

cTt = I dt a{t) , 

(4.21) 



1 



p[x{t)] = / dt a{t) 



r/2 



J-t/2 (c^r) 

where the angular brackets denote an average over the trajectories x{t) weighted with the stationary 
state measure. The symmetric interval [— t/2,t/2] has been chosen in order to have simpler formulae 
in the following. The PDF of p is defined as 

^r(p) = r{p[x{t)] =p} = { d{p[x{t)] -p)) , (4.22) 

and the large deviation function is given by 

Coo(p)= lim T^Mog[7r,(p)/7r,(l)] , (4.23) 

and is normalized by the condition Coo(l) = 0, where (p) = 1 is the average value of p, i.e. the value 
of p in which Coo (p) assumes its maximum. The characteristic function is given by 

2^00 (A) = - lim log(exp[-Aa^]) , (4.24) 

T— ^OO 

and is the Legendre transform of Coo(p)- Indeed, for large t, 

e-x.oc(A) ^ ^g-Aa.^ ^ £ (4 25) 
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so that, recalling that Coo(l) = by construction, 



^cx>(A) = - max[Ccx>(p) - Apo-+] . (4.26) 
p 

The inversion of the Legendre transform yields 

Coo {p) = mm[Xpa+ - Zoo (A)] . (4.27) 

The fluctuation relation is given, in terms of Coo(p)j by Eq. (4.11), and by Eq. (4.26), it can be 
formulated in terms of -2;oo(A) as 2:oo(A) = Zoo(l — A). 

4.3.1 Internal symmetries and the fluctuation relation 

Assume that there exist a map / on the space of trajectories x{t) such that — 1 and that the measure 
Vx is invariant under /, i.e. VIx — Vx. Then, consider a segment of trajectory x{t), t S [—r/2, t/2] 
and define 

where ^[^(t)] is the probability of observing x{t), in stationary state, for t € [—r/2, r/2] irrespectively 
of what happens outside the interval [—t/2, t/2]. The PDF of a^- verifies the fluctuation relation: 

{6-^"-)= I VxV[x{t)]e-^''- = j VxV[x{t)Y-^V[Ix{t)]^ 

. (4.29) 
VxV[Ix{t)Y-^V[x{t)]^ = {e-^^-^>^) . 



Thus, if the limit (4.24) exists, it verifies the relation 2;oo(A) = Zoo(l — A), from which the fluctuation 
relation for the PDF of cTt- follows. This definition of cr^ was proposed by Lebowitz and Spohn [108], 
who showed that the limit -2oo(A) indeed exists for generic Markov processes and it is a concave 
function of A. Moreover they showed that CTt can be identified with the entropy production rate -over 
the time interval r in stationary state up to boundary terms, i.e. terms that do not grow with r, 
if I is chosen to be the time reversal, Ix{t) = x{—t). It turns out that cr,- can be identified with the 
entropy production rate over the time interval r in many of the physical interesting cases, as will be 
discussed below. 



4.3.2 The fluctuation theorem 

The hc;uristic derivation above can be formulated as a theorem for reversible Anosov maps [92, 93]. In 
these deterministic systems, the stationary measure over the space of trajectories S*x is simply the SRB 
measure over the initial data x, and is given by Eq. (4.19). The map / is the time reversal map, which 
satisfies P = 1 and is metric preserving (that means that the measure Vx is invariant under its action). 
Moreover the time reversal / is defined by 75 = S~^I, so that L+{S^Ix) = L+{IS~*x) = — i_(S'~*a;), 
where the last equality follows from L+{Ix) = —L-{x) which holds for reversible systems. Then the 
quantity cr^ defined in Eq. (4.28) becomes 

a. = -log^^= L+iSHx)- 2 L^{S'x) 

^'+^^) t=-r/2 t=-r/2 ^ ^ 

4.30 

r/2 r/2 ^ ' 

= - ^ L+{S'x)+L_{S'x) = - ^ a{S'x), 

t=-r/2 t=-T/2 
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so that cJx can be identified with the phase space contraction rate a{x) = —L^[x) — L-(x) integrated 
over the time interval r, as in Eq. (4.9). It follows that the validity of the fluctuation relation for 
Anosov systems is a consequence of reversibility and of the structure of the SRB measure, Eq. (4.19). 



4.4 Entropy production rate and some consequences of the 
chaotic hypothesis 

In many practical cases [30, 80, 81, 94, 95, 96, 100, 102, 108] it turns out that the quantity cr^ defined 
in Eq. (4.28) can be interpreted as the total entropy production over the time interval r, i.e. the 
integral of an entropy production rate s{t) which is usually given by the power injected in the system 
by the nonconservative forces acting on it divided by some "temperature" , which in systems of classical 
particles is identified with the kinetic temperature and in stochastic systems in contact with a thermal 
bath is the temperature of the thermal bath. 

However this identification is still matter of debate, see e.g. [30, 80, 81, 82, 84, 108]. On a 
practical ground, there are many nonequilibrium situations in which it is not clear how to define 
a "temperature": this happens in strongly nonequilibrium regimes, for instance when the driving 
force is very strong or in the glassy cases discussed in the first chapters. So the definition of entropy 
production rate as the injected power divided by the temperature is not always free of ambiguities. 

It is not obvious that the problem of defining the notions of "entropy" and "entropy production 
rate" in general nonequilibrium situations can be solved. In chapter 7 some aspects of this problem 
will be discussed. For the moment, the entropy production rate will be identified with Eq. (4.28), or, 
in the case of dynamical systems, following the chaotic hypothesis and the discussion in section 4.3.2, 
with the phase space contraction rate a{x). Some consequences of this identification will now be 
discussed. 

4.4.1 The fluctuation relation close to equilibrium 

Green-Kubo relations 

It was proved in [109, 110, 111] that the fluctuation theorem implies, in the equilibrium limit (cr+ — + 0), 
the Green-Kubo relations for transport coefficients. This holds if the identification between entropy 
production rate and phase space contraction rate is accepted, at least close to equilibrium. 

Suppose that a constant driving force E is applied to a system in equilibrium. This generates a 
corresponding flux J{t) (e.g. if E is an electric field J{t) is the electric current) such that, close to 
equilibrium, the dissipated power can be written as W{t) = EJ(t) + 0{E^) [82]. At first order in 
the force E, the temperature is simply the equilibrium temperature, and the entropy production rate 
is [82]: 

,«) = m = M!),0(^=). (4.31) 

The fluctuation relation can be written as 2oo(A) = Zoo(l — A) where Zoo(A) is deflned in Eq. (4.24) 
and (7r in Eq. (4.21). The derivatives of ZooW are the moments of ar, i.e. 



Jk) 



d\^ 



= (-l)'=-Mim T-i(a^)c, (4.32) 



A=0 



where denotes the connected correlation (e.g. (^^)c = — (^)^)- It is possible to show, see 

Appendix 4.5, that = a+ E'^ and that, for A; > 1, 2:^^ ~ E^ . Then, close to equilibrium (^E ~ 0) 
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-Zoo (A) is well approximated by a second order polynomial (corresponding to a Gaussian pdf), 

z^{X) = zgh + -^X^ + 0{E^X^) , (4.33) 

and the fluctuation relation, 2;oo(A) — Zac{l — A), implies z^-* = —22;^''; from equation (4.32), recalling 
that (Tx = '^^ '^(^^ using time-translation invariance, 

POO 

zg^ = -2zg^ a+= dt (a(t)a(0))e • (4.34) 

Jo 

Substituting a{t) = EJ{t)/T one obtains 

{J)e = j;J^ dt{J{t)J{0))E=o + 0{E^) , (4.35) 

that is to say, the Green-Kubo relation. 

In the case where many forces Ei are applied to the system, each of them is associated to the 
corresponding current Jj and the dissipated power is, at first order in E_, W{t) = J2i EiJi{t) = E_J_{t). 
In the limit ^ — > 0, an extension of the fluctuation theorem to the joint fluctuations of p and of 
Ji{t) = TdEi<y{t) [109] leads then to Green-Kubo's formulas for transport coefficients: 

/ T \ 1 POO 

^ hm ^ = - dt {J,{t)JjiO))E=o , (4.36) 
and to Onsager reciprocity, = fxji [109, 110, 111]. 
Fluxes far from equilibrium 

If the identification between entropy production rate and phase space contraction rate is accepted 
also far from equilibrium, one can define a "duality" between fluxes J_ and forces E using a{x) as a 
"Lagrangian" [84]: 

Close to equilibrium one has J^{t) = J.{t)/T and the Green-Kubo relations follow. 
Gaussian distributions 

The only assumption in the derivation of the Green-Kubo relation above was that in the limit (7+ — > 

the distribution TTrip) can be approximated by a Gaussian, or equivalently Eq. (4.33), see Appendix 4.5. 
Thus, if under some particular conditions the distribution of p is observed to be a Gaussian over the 
whole accessible range®, one obtains from the fluctuation relation the same relation = —22,^^ 
which is, in this case, an extension of a Green-Kubo formula, Eq. (4.36), to finite forces. 

One sees this by considering, for instance, cases in which a{x) is linear in E (as it will happen in 
the cases that will be studied in the following). Indeed, if a{t) = EJ{t), one obtains the relation 



E 



dt [{jmrnE - , (4.38) 







valid, subject to the Gaussian assumption, also for E ^ 0. If a{t) is non linear in E, Eq. (4.38) will 
assume the appropriate form for the system under investigation. The leading order in E of the latter 
relation {linear response) is obviously the Green-Kubo formula, Eq. (4.36). 

^The accessible range must include negative values of p, otherwise the fluctuation relation cannot be applied. 
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4.4.2 (Dynamical) ensembles equivalence 

Following what is usually done in equilibrium, one can define a nonequilibrium ensemble as the collec- 
tion of probability distributions (SRB distributions) describing the stationary states of a given system, 
say Eq. (4.4), when the parameters A'', V, E, etc. are varied [30, 84]. 

However, as was already remarked above, the SRB distributions depend explicitly on the dynamics 
of the system, see Eq. (4.19), hence on the details of the ocjuations of motion, e.g. Eq. (4.4). This 
means that they can in principle depend on the precise form of the thermostatting force 0^{q,q) 
which ensures the existence of a stationary state by subtracting the energy which is injected by the 
nonconservative forces. Then, there is much more freedom in nonequilibrium to define ensembles: for 
instance, one can choose 0_E{q,q) in order to keep the total energy (or kinetic energy) fixed, or one 
can simply set Q_^{q,q) = vq, with v a constant friction. Also one can use a stochastic thermostat, 
if 0_^{q- q) is a random variable. The thermostat could be chosen to act in the bulk of the system or 
only on the boundaries, etc. 

All these choices will lead to a different probability distribution for the stationary state. For exam- 
ple, the first two define a reversible equation, so one can expect that the resulting SRB distribution will 
verify the fluctuation relation. But if one sets ^£;(<Z, g) = vq, the resulting equation is not reversible, 
so in principle the resulting SRB distribution should not satisfy the fluctuation relation. Moreover, 
in the case of a stochastic thermostat, the resulting probability distribution is expected to admit a 
density w.r.t. volume from the general theory of stochastic processes, while the SRB distributions 
describing the other thermostats is concentrated on a set of zero volume. Nothing could seem more 
diflferent [30]. 

Nevertheless, it might still be true that, if the size of the system is large enough, and if one 
looks only to a small portion of the system that is far from the boundaries, the resulting statistical 
behavior is the same. This is what one should expect on "physical" ground, and is similar to what 
happens in equilibrium where the canonical and micro canonical ensembles give the same statistical 
behavior even if the second is supported on a constant energy surface which has zero measure w.r.t. 
the first. Obviously, the fluctuations of the total energy will be very different in the canonical and 
microcanonical ensembles, so one should keep in mind that the equivalence might hold only if one 
looks to a small volume of the total system which is far from the boundaries and if the details of the 
system are not probed by the observables under investigation. 

A general theory of ensembles and their equivalence is still lacking so the statements above are 
stiff only conjectures [30, 84, 112, 113, 114]. However: 

(1) in systems of classical particles like Eq. (4.4), some arguments have been proposed that support 
the equivalence of some particular choices of the function 9_E{q,q) within linear response theory [80, 
115, 116] and beyond [114]; 

(2) in some applications to fluid mechanics the equivalence of the Navier-Stokes equations to similar, 
reversible, equations has been numerically shown [30, 90, 101, 117]. 

Some numerical results about nonequilibrium ensemble equivalence have been obtained during this 
work and were published in [100]. They will not be reproduced here for reasons of space. 

4.4.3 Singularities 

The application of the discussion above to concrete cases poses some problems due to the presence 
of singularities, e.g. the divergence in the origin of the Lennard-Jones potential. Indeed, the main 
assumption defining Anosov systems is smoothness, which is clearly violated by the Lennard-Jones 
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potential due to the presence of the singularity in the origin. It turns out that, if the discussion is 
suitably adapted, still one can expect the fluctuation relation to hold [118]. This is the purpose of 
this section. 

The problems arise if one consider Eq. (4.4) in presence of an unbounded potential V{q) and if 
d{q, q) is chosen in order to keep the total kinetic energy constant. In this case the phase space 
contraction rate a{q, q) has the form 

^ ^ EJ{q, q) 1 dV , , 

.fei) = ^-^^, (4.39) 

i.e. it is the sum of the dissipated power (whose precise form in a concrete case will be given in next 
chapter) divided by the kinetic temperature and of a term which is the total derivative of the potential 
energy divided by T. 

Even in the conservative case E = 0, is not identically 0: it has zero average but still has 
fluctuations. Moreover, as the potential energy is unbounded, the integral cTx will contain a term 
[V{—t/2) — V{t/2)]/T which is unbounded. The problem is that the fluctuation relation was derived 
under the assumption that cr,- is bounded (being a smooth function on a compact manifold). The 
"spurious" unbounded fluctuations due to the total derivative term, which has zero average so it does 
not contribute to the dissipation, will produce a violation of the fluctuation relation. The purpose of 
the following discussion is to explain the effect of this term and why it should be removed to obtain 
a proper definition of phase space contraction rate in singular systems. 

Conservative systems and total derivatives 

The situation described above (for = 0) is a particular instance of a system that is conservative but 
does not have an identically vanishing (t(.t). 

Indeed, Ruellc showed [83] that in general a+ > 0, and that if (7_|_ = then (t{x) has necessarily 
the form a{x) = f{Sx) — f{x), or a{x) = ^ in the continuous case, for a suitable function f{x). 
Note that this happens also if one considers a system that conserves the volume, so that 17(0;) = 0, 
and changes the metric on phase space to a new metric d'x = exp[— f {x)]dx . In this case the phase 
space contraction rate w.r.t. the new metric is <j'(x) = Thus total derivatives in (t(x) can be 
eliminated by changing the metric on M. This means that if a{x) is a total derivative the system still 
admits an absolutely continuous SRB distribution w.r.t. volume. This will be the general definition 
of conservative system that will be adopted in the following. 

If f{x) is bounded, the variable 

a=l E^.(5^.).^(^^-)-/^"^-) (4.40) 

is also bounded by and tends uniformly to 0. In the dissipative case, a+ > 0, if a{x) = ao{x) + 
the variable p defined in Eq. (4.21) will be simply given hy p = po + a/a+, where po is obtained 
substituting in Eq. (4.21) the expression of a{x) without the total derivative term. But for large r 
the term a/a+ tends uniformly to so one simply has p = pq. This means that total derivatives of 
bounded functions can always be neglected in the definition of p, Eq. (4.21). 

A simple example: Anosov flows 

The latter statement is not true if the function f{x) can become infinite in some point xo, as is the 
case for the Lennard- Jones potential V{x). 
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The simplest example (out of many) is provided by the simplest conservative system which is 
strictly an Anosov transitive system and which has therefore an SRB distribution: this is the geodesic 
flow on a surface of constant negative curvature [119]. The phase space M is compact, time reversal 
is just momentum reversal and the natural metric, induced by the Lobatchevsky metric g{x) on the 
surface, is time reversal invariant: the SRB distribution is the Liouville distribution and cr(x) = 0. 
However as before one can define a new metric as g'{x) = e~^'^^^g{x) where f{x) is a time reversal 
invariant function on M whose modulus is very large in a small vicinity of a point xq, arbitrarily 
selected, and constant outside a slightly larger vicinity of xq. The rate of change of phase space 
volume in the new metric will be cr'(x) = ^ and since / is arbitrary one can achieve a value of cr'{x) 
as large as wished by fixing suitably the function /. 

Nevertheless, as long as f{x) is bounded, a — ^ a'{Stx)dt = [/{Stx) — f{x)] ^^^oo (as 
in the corresponding map case), and the SRB distribution of a will be a delta function at 0. But if 
f{x) is not bounded (e.g. if it is allowed to become infinite in a;o) the distribution of a can be different 
from a delta function at also for conservative systems, yielding a finite large deviation function 
C(a) = lim^^oo 7log7rT-(a). This will affect the distribution of p also for t ^ oo. In this case it is 
clear that this is a "spurious" effect related to a very strange choice of the metric on M, but realizing 
this in realistic systems can be sometimes difficult. 

The effect of singular boundary terms 

One can show that terms of the form [f{Srx) — /(a;)] with f{x) not bounded can affect the large 
fluctuations of a{x). This is a valuable and interesting remark brought up for the first time in [120]. 

Consider a system such that a{x) has the form a{x) = cro(x) — P = and (Jq{x) is 

bounded. In such cases the non normalized variable a = pcr^, see Eq. (4.40), has the form 



where V^, Vf arc the values of the potential at the initial and final instants of the time interval of size 



If the system is chaotic the variables ao,Vi, Vf can be regarded as independently distributed and 
the distribution of V = Vi ov V = Vf is essentially e~'^^dV, i.e. close to the equilibrium Gibbsian 
distribution [80], equal to leading order as F ^ oo to e~'^^ . Therefore the probability distribution of 
the variable a can be computed as 




(4.41) 



T on which a is defined, and ao = ^ ao{Stx)dt. 




dVi / dVf e^^°^''°^-^^'-^^fS[T{a - ao) - fiVf + m] 



(4.42) 



thus 



C(a) = 



max I 

aoe[-p*o-+,P*o-+] - 



Co(ao) - |a - ao| 



(4.43) 



Defining anp by Co('^t) = ilj by the strict convexity of Co(<io) it follows 



Co (fl- ) — a_ + o , a < a_ , 
C(a) = \ £o(a) , a G [a_,a+] , 

Co(a+)+a+-a , a>a+. 



(4.44) 



4.4. ENTROPY PRODUCTION RATE 



73 




Figure 4.2: An example in a stochastic model. The graph gives the two functions Co (a) and C,{a) 
for h = 0., 0.25, 0.5. The average of a is (a) = (7+ = 2hta.nhh, a+ = 2/itanh3/i and a* = 2h. The 
function C(a) is obtained from Co{a) by continuing it for a < a_ = —0"+ and a > a+ with straight lines 
of slope ±1. It does not satisfy the fluctuation relation for \a\ > (a). As h 0, (a) ^ 0, which means 
that the interval in which the fluctuation relation is verified shrinks to 0. In this limit — s- 0, so ({a) 
approaches — \a\ (dashed lines). Rephrasing this in terms oi p = one obtains that the fluctuation 
relation remains always valid for \p\ < 1, even as /i ^ 0. The three curves for Co(a) have the same 
tangent on left side. The function Co(a) is finite only in the interval [—2h, 2h] and it is — oo outside it, 
while the function C(a) is finite for all a'a and is a straight line outside [a_, a+]. 

Furthermore, if Co(ao) verifies the fluctuation relation, Co(ao) — Co(^ao) + ag, by differentiation it 
follows that a_ = — cr+, where cr+ is the maximum of i-o. the average of a. 

It follows that, if Co(ao) satisfies the fluctuation relation up to a = p*cr+, then C(a) satisfies the 
fluctuation relation only in the interval \a\ < |a_| = a+. Outside this interval C(a) does not satisfy 
the fluctuation relation and in particular for a > it is C(a) — Ci~o,) = const., as already described 
in [120]. Translated into the normalized variables po = ao/f+ and p = a/a^, this means that, even 
if the large deviation function of po satisfies the fluctuation relation up to p* > 1 , the large deviation 
function of p verifies the fluctuation relation only for \p\ < 1. This effect is due to the presence of the 
singular boundary term. 

An example of <^{a) is reported in Fig. 4.2: it is a simple stochastic model for the FT (taken from 
[95], see also the extensions in [108, 121]). The example is the Ising model without interaction in a field 
h, i.e. a Bernoulli scheme with symbols ± with probabilities p± — j^^^jt^- Defining — 12i=o ^^cTi j 
so that 0"+ = (ag) ~ 2/itanh/i, and setting x = I+Bililhl^ and s{x) = —a; log a;— (l — x) log(l — x), one 
computes Co(ao) = s{x) + ^ao + const which is not Gaussian and it is defined in the interval [—a*, a*] 
with a* — 2h. In this case the large deviation function Co(ao) satisfies the fluctuation relation for 
jaoj < a*. If a singular term V = — ^og{J2ilo 2~*~^^^j-!-) is added to ao, defining a = ao + (3{Vi — Vf) 
(with f3 = log2(l + e^'*) so that the probability distribution oiV is ^ e~^^ for large V), the resulting 
C(a) does not verify the fluctuation relation for a > (a) = 2/itanh/i. In particular, for /i — )■ 0, the 
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interval in which the fluctuation relation is satisfied vanishes. 
How to remove singularities 

Prom the discussion above it turns out that singular terms which are proportional to total derivatives 
of unbounded functions (like the term ^ that appears in the phase space contraction rate of isokinetic 
systems) can induce "undesired" (or "unphysical" ) modifications of the large deviation function C(p)- 

On heuristic grounds, when dealing with singular systems, one could follow the prescription that 
unbounded terms in a{x) which are proportional to total derivatives should be subtracted from the 
phase space contraction rate. If the resulting a{x) is bounded (as it is e.g. for the isokinetic thermostat) 
then its distribution should verify the fluctuation relation for \p\ < p* , p* being an intrinsic dynamic 
quantity defined by lim|p|^p. ({p) = — oo. If the singular terms are not subtracted, the fluctuation 
relation will appear to be valid only for \p\ < 1 even if p* > 1. 

The heuristic prescription above can be motivated by a careful analysis of the proof of the fluctua- 
tion theorem for Anosov flows. In the following let us call again a the integral of the total phase space 
contraction rate a{x) (which includes singular terms) and uq the integral of the bounded variable 
ao{x) from which singular total derivatives have been removed. 

The fluctuation theorem was proved in [122] for Anosov flows. Flows are associated with maps 
via Poincare's sections: excluding singular sections which pass through a point of singularity in phase 
space (which is a very natural restriction) the chaotic hypothesis would lead to a fluctuation relation 
for the phase space contraction on a Poincare's section and this would lead to a fluctuation relation for 
the flow by the theory in [122] only if the variable a{x) is bounded. However if the Poincare's section 
is performed avoiding the singular points, like the passage through points in which the potential is 
infinite, then the phase space contraction (taken for instance assuming as timing events the instants 
in which the potential energy exceeds some large value) has two contributions: the first is from ag 
which is bounded (at least in the isokinetic thermostats) and the second from the potential. The 
latter however has again the form proportional to the difference of the potential energy at the initial 
timing event and at the final event: this vanishes on the section considered above while in general 
it will have the form of ^ times a bounded quantity (unless the section passes through a singularity 
of the potential). Therefore the distribution of ao will satisfy the fluctuation relation {by the chaotic 
hypothesis) for |ao| < p*<J+. By the above maximum argument, the distribution of a will also verify, 
as a consequence, the fluctuation relation but only for \a\ < a+ (i.e. for \p\ < 1). 

The (natural) prescription is then to consider only Poincare's sections which do not pass through a 
singularity of a{x). The integral of a{x) over a large number of timing events on such sections is equal 
to the time integral of ao{x) plus a bounded term which can be neglected. Thus the prescription on the 
Poincare's section is equivalent to the heuristic prescription of removing from a{x) all the unbounded 

total derivatives. 

It follows that the chaotic hypothesis leads to a prediction on the outcome of possible numeri- 
cal simulations in which the isokinetic thermostat is assumed in particle systems interacting via a 
Lennard- Jones potential: the fluctuation relation will hold for all jaj < (t+ and, once the term ^ 

is removed, for all |ao| < p*cr-f- with p* > 1, even for the latter models which admittedly are quite 
unphysical as the speed of the particles remains essentially constant even in "head on" collisions in 
which the potential energy acquire an infinite value. The numerical results of the following chapter 
[100, 102] closely agree with this prediction and can be considered as rather demanding tests of it. 
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4.4.4 Some remarks on the chaotic hypothesis 

(1) It has to be stressed that the chaotic hypothesis concerns physical systems: it is very easy to find 
dynamical systems for which it does not hold. As it is easy (actually even easier) to find systems in 
which the ergodic hypothesis does not hold (e.g. harmonic lattices or black body radiation) but, if 
suitably interpreted, leads to physically correct results (the specific heats at high temperature) or, 
when it really fails, to new scientific paradigms (like quantum mechanics from the specific heats at 
low temperature and Planck's law). 

(2) Since physical systems are almost always not Anosov systems it is very likely that probing motions 
in extreme regimes (e.g. when particles go undisturbed through infinite potential walls, as in the 
Lennard- Jones isokinetic models) will make visible the features that distinguish Anosov systems from 
non Anosov systems: e.g. the isokinetic thermostats satisfy the fiuctuation relation for \p\ < 1 only 
(if the term ^ is not removed from cr(x)). Note that this results can be derived from the chaotic 
hypothesis as discussed above: this is a quite remarkable fact. 

(3) If the term ^ is removed (as will be done in the following), the resulting quantity ao{x) is bounded 
and its distribution verifies the fluctuation relation also for \p\ > 1. This prescription, as discussed 
above, is equivalent to the very reasonable prescription that the Poincare's section used for mapping 
the flow into a map does not pass through a singularity of a{x). 



4.5 Appendix: The large deviation function of a{x) close to 
equilibrium 

Close to equilibrium the entropy production rate has the form a{t) = EJ{t), as discussed in sec- 
tion 4.4.1. Thus, from Eq. (4.32), 

2« = (-1)'=-^ lim r-i (a^)^ = {-if-^E'' lim t'^ f'^ dh ■ ■ ■ f'^ dt^ {J{h) ■ ■ ■ J{tu)), . 

(4.45) 

The connected correlations {J{ti) ■ ■ ■ J{tk))^ are translationally invariant due to the stationarity of 
the SRB distribution and decay exponentially in the differences \ti — tj\ due to the short range property 
of the SRB potentials. 

From stationarity it follows that zi^-* = E {J') and as {J') = in equilibrium, one has {J') ~ E 
and = a+ ^ E"^ . Using stationarity and the exponential decay of the connected correlations one 
has, for A; > 1, 

fT/2 /•t/2 

lim T"^ / dh--- dtk {Jih) - - - J{tk))^ = 

■r^oo J-r/2 J-t/2 



/oo POO 
dh--- dtk-1 {JiO)J{ti) ■ ■ ■ J{tk-i)), = J^^ 
-oo J — oo 



(4.46) 



and the are finite for E —^ 0. This means that the ~ iJ'^ for /c > 1 and 

.oo(A) = zg^X + + 0{E^X^) . (4.47) 

Equivalently, from the relation Coo(p) = minA[ApCT+ — Zoo(A)] one can prove that'^ 

Coo W = 4) (^^ - 1)' - ^r^iP -lf + --- = 4j(p - 1)^ + 0{E^{p - If) , (4.48) 
'Note that is negative. 
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i.e. that Coo(p) is approximated by a Gaussian in an interval 1| ~ whose size grows for E ^ 0, 
see also [109]. 



Chapter 5 

Numerical tests of the Fluctuation 
Relation 

5.1 Introduction 

As discussed in section 4.4.1, close to equilibrium the PDF of the phase space contraction rate is close 
to a Gaussian, and the fluctuation relation is equivalent to the Green-Kubo relations obtained within 
linear response theory. Thus, a test of the fluctuation relation in this context is not really independent 
from linear response theory. 

A rather stringent test of the chaotic hypothesis would be a check which cannot be reduced to a 
kind of Green-Kubo relation; this requires at least one of the two following conditions to be satisfied: 

1. the distribution 7r^(p) is distinguishable from a Gaussian, or 

2. deviations from the leading order in E in Eq. (4.38), i.e. deviations from the Green-Kubo 
relation, are observed. 

This is very hard to obtain in numerical simulations of Eq. (4.4) for the following reasons; 

1. to observe deviations from linearity in Eq. (4.38) one has to apply very large forces E, then (t+ 
is very large and it becomes very difficult to observe the negative values of p{x) that are needed 
to compute Coo(^J') in Eq. (4.11); 

2. deviations from Gaussianity in T^rip) sue observed only for values of p that differ significantly 
(of the order of 2 times the variance) from 1 and, again, it is very difficult to observe such values 
of p. 

Due to the limited computational resources available in the past decade, all numerical computations 
that can be found in the literature on systems described by Eq. (4.4) found that the measured distri- 
bution TTrip) could not be distinguished from a Gaussian distribution in the interval of p accessible to 
the numerical experiment [94, 95, 96, 100]. 

In this chapter a test of the fluctuation relation, in a numerical simulation of a system described by 
Eq. (4.4), for large applied force when deviations from linearity can be observed, and the distribution 
TTr{p) is appreciably non-Gaussian, will be presented [102]. This has become possible thanks to the fast 
increase of computational power in the last decade. However, it is still very difficult to reach values 
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of T which can be confidently regarded as "close" to the asymptotic limit r ^ oo; thus to interpret 
the results a theory of the o(l) corrections to the function Coo(p) has to be developed in order to 
extract the limiting function Coo{p) from the numerical data. Taking into account the latter finite 
time corrections, the fluctuation relation will be successfully tested for non-Gaussian distributions 
and beyond the linear response theory. A similar analysis has been presented in [123], where however 
negative values of p were not directly observed. 



5.2 Finite time corrections to the Fluctuation Relation 

In the present section a strategy to study (in principle constructively) the 0(1) corrections in the 
exponent of Eq. (4.10) will be described. The theory holds assuming that the time evolution is 
hyperbolic so that it can be applied to physical systems only if the chaotic hypothesis is accepted. For 
simplicity only the case of discrete time evolution via a map S are considered. 

5.2.1 Finite time corrections to the chciracteristic function 

The distribution of p at fixed r can be studied via its Laplace transform {characteristic function) 

z^{X) = -1 log(e-^^J=o ^(^'^)) . (5.1) 

T 

Prom the explicit expression of the SRB measure, see Eq. (4.20), it can computed as 

g-ExcAy Exo [0,T-1] 

e-TzAx) = £li ^ ^ . (5.2) 

This means that it is the (limit as T ^ oo of the) ratio between the partition functions Zt{^+) of a 
Gibbs distribution in At with potential (the denominator) and the partition function Zt{^+, Xs) 
with the same potential modified in the finite region [0, r — 1] C Z by the addition of a potential 

Xs{sx). 

The one dimensional systems are very well understood and the above is a well studied problem in 
statistical mechanics, known as a finite size corrections calculation. For instance it can be attacked 
by cluster expansion [91]; this is a technique to deal with the average of the exponential of a spin 
Hamiltonian which is defined in terms of potentials (j) exponentially decaying with rate k, such as 
those appearing in the numerator and in the denominator of Eq. (5.2). It allows us to represent them 
as: 

^ g-ExcAy l^^fex) _ g-ExcA.j, ^ (g g-J 

where are new effective potentials, explicitly computable in terms of suitable averages of products 
of <?!>(ej(-)'s, and which can be proven to be still exponentially decaying with the diameter of X with a 

rate < k' < k. 

In particular, a representation like Eq. (5.3) allows to rewrite the partition function in the denom- 
inator of Eq. (5.2) as: 

ZT($+)=exp[(2T+l)/oo($+)-Coo($+) + 0(e-«'^)] , (5.4) 
and the one in the numerator as 
Zt($+,As) =exp [(2T+l-T)/<x,($+)+r/^($+ + As)-Coo($+)-5oo(A) + 0(e-«'^ + e-«'^)l . (5.5) 
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Therefore 



Zr{X) = /oo($+) - /oo($+ + As) + 



(5.6) 



The function Zoo(A) is convex in A and the functions (?oo(A) and -Zt(A) are analytic in A (a con- 
sequence of the l-dimensionaUty and of the short range nature of the SRB distribution): namely 
fl'oo(A) = ffTO^A + ^5^^A^ + . . . and Zr{X) = zi^^\+ ^z^^X^ + ■ ■ ■ and the coefficients of their expansion 
in a power series of A can be expressed in terms of correlation functions of a{x). For instance, from 
Eq. (5.1) and using the translational invariance of the SRB measure, 



4i)=T-i(^a(5^x))=a+ , 



T-l 



4')= 



r-l T-l 
j=0 j=0 fe=0 

T-l 



(5.7) 



= - E 

fc=-T+l 



1- 



\k\ 



{a{S''x)a{x))c , 



where {a{S'^x)a{x))c = {a{S'^x)a{x)) — a\. Using Eq. (5.6), (7oo(A) = \\m.T^ooT[zr{X) — Zao{X)\, and 
the analyticity of -2t(A), one has g'^ = lim^^oo t[zt^ — z'^]. Since the connected correlation function 



{a{S'^x)(j{x))c decays exponentially for fc — > oo, one obtains 



J2 \k\{a{S'^x)a{x))e . 



(5.8) 



k=—oo 



5.2.2 Finite time corrections to Cco(p) 

A direct measurement of ^;t(A) from the numerical data is difficult. What is really accessible to 
numerical observation are the quantities ^ log7rT-({p G A}) in Eq. (4.10) because the measured values 
of p are used to build an histogram obtained by dividing the p-axis into sufficiently small bins A and 
counting how many values of p fall in the various bins. The size of the bins A will be chosen to be 
|A| = 0(ei-/T), with Sr a small parameter which will be eventually chosen = o(l), see Appendix 5.8 
for a discussion of this point. Let also pa be the center of the bin A. An application of a local form of 
central limit theorem, discussed in Appendix 5.8, shows that the following asymptotic representation 
ofiTriip € A}) holds: 

nr{{p G A}) = e"«-(f^) (l + o(l)) , (5.9) 
where Ct(pa) can be interpolated by an analytic function of p, satisfying the equation 

Cr{p) = -Zr{\) + Appcr+ - ^ log 

and Ap is the inverse of p{X) = z'^{X)/a+. Using the previous equations, the lowest order finite time 
correction to Coo(p) around the maximum can be computed. 

First one rewrites Ct(p) as Ct(p) = Coo(p) + + 0{^). By the analyticity of Ct(p), one can 

write Coo(p),7oo(p) around p = 1 in the form: Coo(p) = kcS,\p - 1)^ + ^C<^''(p - 1)^ + . . . and 
7oo(p)=7^^+7^^(p-1) + --- 



2tt 



(5.10) 
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Up to terms of order {p — 1)^ and higher in the series for "foo{p), one has: 



Thus, the finite time corrections to Coo(p) around its maximum begin with a shift of the maximum at 

To apply the latter result one needs to compute 7,^'' in terms of observable quantities. And, in order 
to compute one can apply Eq. (5.10). First of all, note that \p is determined by the condition 

pa+ = 4(Ap) = a++ 4'(0)Ap + 0{Xl) , (5.13) 

where Eq. (5.7) and Eq. (5.8) have been used. Then, Ap = ^^^^ + 0{{p - if). Substituting this 
result into Eq. (5.10) and equating the terms of order 0(2^) at both sides one finds: 



1 r'-'^V 



,(3) 

The last equation can also be rewritten as: 

This can be proven recalling that and Coo^ are derivatives of Coo(p) in p = 1, that can be obtained 
by differentiating w.r.t. A (two or three times, respectively) the definition Coo (2L(A)/cr+) — — 2:oo(A) + 
\z'^{\) and computing the derivatives in A = recalling that z^(0)/cr+ = 1. Plugging Eq. (5.15) 
into Eq. (5.12) one finally gets 

Po = l- +0 - , (5.16) 



that is the main result of this section. The key point is that the moments Coo^ and Coo^ in Eq. (5.16) 
are quantities that can be measured from the numerical data (within an 0(r~^) error). One then has 
a verifiable prediction on the expected shift of the maximum at finite r. The data agree very well 
with this prediction, sec Fig. 5.1 and corresponding discussion in section 5.4 below. 
Substituting Eq. (5.16) in Eq. (5.11), one finally finds: 



Coo(p) = »?r(p) + 0(^^-^) +0(t-1) , (5.17) 

where r]r{p) is defined as 

The key point of the above discussion was the validity of Eq. (5.9-5.10); see Appendix 5.8 for their 
derivation. 
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5.2.3 Remarks 

(1) The shift away from 1 of the maximum of the function Ct(p) at finite r, expressed by the second 
term in Eq. (5.18), is due to the asymmetry of the distribution 'Krip) around the average value p = 1; 
consequently, it is proportional, at leading order in r~^, to C,'^'' which is indeed a measure of the 
asymmetry of Coo(p) around p=l. This shift would be absent in the case of a symmetric distribution 
(e.g. a Gaussian) and for this reason it was not observed in previous experiments [94, 95, 96, 100]. 

(2) The error term in the r.h.s. of Eq. (5.9) is o(l) w.r.t. r and it does not affect the computation of 
7oo(p). It is then clear that with a calculation similar to that performed above, one can get equations 
for the coefficients 0(A'°) in the exponents of Eq. (5.9); in this way one can iteratively construct the 
whole sequence of coefficients defining the power series expansion of 700 {p) ■ 

(3) In models with continuous time evolution the quantity a+ is not dimensionless but it has 
dimensions of inverse time: in such cases one can imagine that one is still studying a map which 
maps a system configuration at a time when some prefixed event happens in the system (typically a 
"collision" ) into the next one in which a similar event takes place. If tq is the average time interval 
between such events then tqg^ will play the role played by a+ in the discrete time case: it will be the 
adimensional parameter entering the estimates of the error terms. 

Note that the coefficients g'^ are of order a^, and their size is necessarily estimated by the 
adimensional entropy production to the k tli power. Then, in the continuous time case, the choice of 
To affects the estimates of the remainders, because it affects the size of the adimensional parameter 
rocr_|_; and the size of the mixing time (that is connected with the estimated range of decay of the 
potentials, see [91]). The natural (and physical) choice for tq is the mixing time. Consistently with 
this remark, at the moment of constructing numerically the distribution function for the entropy 
production rate averaged over a time r, time intervals of the form r = tqu, n > 1, will be considered, 
see section 5.3.3 below. 



The model that will be considered in the following is a system of N classical particles of equal mass 
m in dimension d\ they are described by their position qi and momenta pi = mqi, {pi, qi) £ R^'^, i = 
1, . . . ,N. The particles are confined in a cubic box of side L with periodic boundary conditions. Each 
particle is subject to a conservative force, fi{q) = —dq^V{q), and to a nonconservative force Ei that 
does not depend on the phase space variables. The force Ei is locally conservative but not globally 
such due to periodic boundary conditions. The mechanical thermostat is a Gaussian thermostat [80], 
Oi{p, q) = —a{p, q)pi, and the function a{p, q) is defined by the condition that the total kinetic energy 
K[p) = 2^|j5|^ = 2^ TliiPi should be a constant {isokinetic ensemble). The equations of motion are: 



5.3 Models 




(5.19) 



and are a particular instance of Eq. (4.4). Prom the constraint ^ = one obtains 



a{p,q) = 



Y^i^i Pi + T,iMg) Pi 
EiPf 



(5.20) 
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5.3.1 Entropy production rate 

The total phase space volume contraction rate for this system is given by: 

^(£' 9) = - E (|| + ^) = dNaip, q) + Y^ = {dN - 1) aip, q) . (5.21) 

Defining the kinetic temperature, T = 2K{p)/{dN — 1), [80], the phase space contraction rate can be 
rewritten as 

Hp,Q) = J, • (5.22) 

The first term is the power dissipated by the external force divided by the kinetic temperature, and 
can be identified with the entropy production rate, see the discussion in section 4.4 and [80, 84, 94]. 
The second term is the total derivative w.r.t. time of the potential energy divided by the temperature: 
following the discussion of section 4.4.3 this term will be removed, and the distribution of the entropy 
production rate s, where s is identified with a minus the total derivative term —V/T in Eq. (5.22), 
will be studied: 

^(£,9) = ^^. (5.23) 

From now on Coo (p) and (.-^ (p) will be the distributions for the fluctuations of the entropy production 
rate s averaged over infinite or finite time, respectively. These will be the objects that will be measured 
and used from now on. 

In order to define the current J{x,E), it is useful to rewrite Ei = Eui, where is a (constant) 
unit vector that specifies the direction of the force acting on the i-th particle. Then, according to 
Eq. (4.37), 

5.3.2 Discretization of the equations of motion 

To perform the numerical simulation, one has to write the equations of motion in a discrete form. 
One possibility is to use the Verlet algorithm [124]; for Hamiltonian equations of motion {i.e., E^ = 
and a = 0) 

^* TO ' 

Pi = Mq) , 



(5.25) 



the Verlet discretization has the form 

<j,(t + dt) = q,{t) + sMdt + \mdt^ , 
p,{t + dt) = Pi{t) + \[fi{t) + Mt + dt)]dt , 

where dt is the time step size. This discretization ensures that the error is 0(dt*) on the positions 
qi (t) in a single time step. The implementation of this algorithm on a computer is discussed in detail 
in [124]. 

However, this method requires the forces fi{t) to depend only on the positions and not on the 
velocities: hence, it has to be adapted to Eq.s (5.19). This has been done in the following way. The 
discretized equations are written as 

'q,{t + dt) = Qiit) + sMdt + 1 [/,(*) +Ei- a{t)pi{t)] dt^ , 

Pi [t + dt) = Pi (t) + Ei + l [fi {t) + fi{t + dt) - a{t)pi {t) - a{t + dt)pi {t + dt)] dt , 
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with the same error as in the standard Verlet discretization. At time t, the positions qi{t), the 
momenta Pi{t), the forces fi{t), and the Gaussian multiplier a{t) are stored in the computer. Then, 
the following operations are performed: 

1. the new positions qi{t + dt) are calculated using the first equation; 

2. using the new positions, the new forces fi{t + dt) are calculated (the conservative forces depend 
only on the positions); 

3. the quantity = pi{t) +Ei + ^ [fii^) + fi {t + dt) — a{t)pi (t)] dt is calculated; note that Pi{t + dt) 
can be expressed in terms of the (known) and the (unknown) a{t + dt) as 

'^^' + ''^= l-aittdt)dt/2 -^ ^'-''^ 

4. substituting Eq. (5.28) in the definition of a{t + dt), Eq. (5.20), a self-consistency equation for 
a{t + dt) is obtained, whose solution is 

a{t + dt) "° 



ao 



l-aodt/2 ' 

5. substituting Eq. (5.29) in Eq. (5.28) Pi{t + dt) can be calculated. 

This procedure allows to calculate the new positions, momenta, forces, and a, at time t + dt according 
to Eq.s (5.27) without approximations, defining a map S such that {p{t + dt) , q{t + dt)) = S {p{t) , q{t)) . 

The simulated (discrete) dynamical system will be defined by the map S{p, q) and will approximate 
the differential equations of motion, Eq. (5.19), with error 0{dt^) for the positions and 0{dt^) for the 
velocities. 

The map 5 satisfies the following properties: 

1. it is reversible, i.e. it exists a map I{p,q) (simply defined by I{p,q) = {~P,q)) such that 
IS = 5-1/; 

2. in the Hamiltonian case {E_ = and a = 0, Eq.s (5.25)) it is volume preserving. 

The first property ensures that assuming the Chaotic Hypothesis the Fluctuation Relation holds for 
the map 5. The second property ensures that at equilibrium the discretization algorithm conserves 
the phase space volume, consistently with the definition of equilibrium system which has been given 
in section 4.4. 



5.3.3 Details of the simulation 

In the simulation, the external force has been chosen of the form Ei = Eui, where the unit vectors 
Ui were parallel to the x direction but with different orientation: half of them were oriented in the 

positive direction, and half in the negative direction, i.e. Ui = (—l)^x, in order to keep the center of 
mass fixed. Two different systems have been considered, selecting interaction potentials widely used 
in numerical simulations (for the purpose of making easier possible future independent checks and 
rederivations of the results): 
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1. (model I) the first investigated system is made by A'^ = 8 particles of equal mass m in d = 2. 
The interaction potential is a sum of pair interactions, V{q) — J2i<j ^(Ift ~ ^^'^ the pair 
interaction is represented by a WCA potential, i.e. a Lennard- Jones potential truncated at the 
minimum: 

+ e , r < ; 
' ' [ , r > \/2a . 

The reduced density was p = Na"^ /LP' =0.95 (that determines L), the kinetic temperature was 
fixed to T = 4g and the time step to dt = O.OOlfo, where = \pmG^e. In the following, all the 
quantities will be reported in units of m, e and g {L.J units). This system was already studied 
in the literature, see e.g. [94, 125]. Different values of the external force E were investigated, 
ranging from E = to E = 25. 

2. [model IT) the second system is a binary mixture of N=20 particles (16 of type A and 4 of type 
B), of equal mass m, in d = 3, interacting via the same WCA potential of model I; the pair 
potential is 

a and /? are indexes that specify the particle species (a,/? € {A, B}). The parameters entering 
the potential are the following: <jab = 0.8(7^^; ctbb = 0.88(T^a; ^ab = l-5e^A; ess = 0.5e^A- 
Similar potentials have been studied, [126, 127], as models for liquids in the supercooled regime 
[i.e., below the melting temperature). For this system the LJ units are m, eAA, and gaa] the 
unit of time is then t^ = sJma^JjeAA. The reduced density was p = Na\j!^IL^ = 1.2 and 
the integration step was dt = O.OOlfo- The unit vectors Ui are chosen such that half of the A 
particles and half of the B particles have positive force in the x direction, and the remaining 
particles have negative force in the x direction. For this system different values of external force 
E e [0, 10] and temperature T £ [0.5, 3] were investigated. 

For each system and for each chosen value of T and E, a very long trajectory was simulated 
(^ 2 • lO^dt) starting from a random initial data; recall that in both systems dt = O.OOlto, to being 
the natural unit time introduced in items (1) and (2) above. After a short transient (^ lO^dt), still 
much bigger than the decay time Tq of self-correlations (that appears to be Tq = 10^ dt), the system 
reached stationarity, in the sense that the instantaneous values of observables (e.g. potential energy, 
Lyapunov exponents) agree with the corresponding asymptotic values within the statistical error of 
the asymptotic values themselves. After this transient J\f values pi, i = l,...,Af, of the variable 
p(.x), defined in Eq. (4.21), were recorded, integrating the entropy production rate, Eq. (5.23) on 
adjacent segments of trajectory of length tq = lOOdt = O.lfo- Note that the length of the time interval 
over which the entropy production rate was averaged was chosen to be equal to the mixing time, 
consistently with the discussion in Remark (4) of section 5.2.3. 

In conclusion, from each simulation run at fixed T and E M ^ 10^ values pi of p{x) are obtained, 
which are the starting point of the data analysis. The value of a+ is estimated by averaging the 
entropy production rate over the whole trajectory. 

From a shorter simulation run the Lyapunov exponents of the map S were also measured using 
the standard algorithm of Benettin et al. [125, 128]. 



Ill r* I 



4e 



r < \/2uafi ; 
r > v/2£7a/3 ; 
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Figure 5.1: Model 1 at E = 5: (left) the function ririp) = Coo(p) + 0((p— Ij^/T) for different values of 
t; (right) the maximum pr of Cr(p) as a function of 1/t. The full line is the prediction of Eq. (5.16), 
P=l-CSV[2r(Ci^y]. 



5.3.4 Remarks 

To conclude this section, note that the WCA potential has a discontinuity in the second derivative. 
Thus, one should be concerned with the possibility that the error in the discretization is not 0{dt*) 
over the g^'s on a single time step, as it should be for potentials F G C*. To check that this is not the 
case (or that at least this does not affect the results) two independent tests have been made: 

1. a system similar to model I but with a potential V G was simulated and (qualitatively) the 
same results were obtained; 

2. model I have been simulated using an adaptive step size algorithm [124]; this kind of algorithms 
adapt the step size dt during the simulation in order to keep constant the difference between a 
single step of size dt and two steps of size dt/2. If the precision of the discretization changed at 
the singular points of the potential, the time step should change abruptly during the simulation, 
while a practically constant time step was observed during the simulation. 

These checks give evidence of the fact that the (isolated) singularities of the potentials do not produce 
relevant effects on the observations; this is probably due to the fact that the set of singular points of 
the total potential energy V{q) has zero measure w.r.t. the SRB measure. 



5.4 Data analysis 

In this section the procedure followed to analyze the numerical data will be described in detail. As 
an example, the data obtained from the simulation of model I at _B = 5 will be discussed. From the 
simulation run a set Vq = {pi}i=i...Af of values of the variable p{x) is obtained, that correspond to 
T = To and are measured on adjacent segments of trajectory. As discussed above, tq = 0.1 = lOOdt 
is of the order of the mixing time, i.e. the time scale over which the correlation functions {e.g. of 
density fluctuations) decay to zero. 
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Figure 5.2: Model I at i? = 5: the estimate of the function Coo(p) (open circles). In the same plot 
Coo{—p) +pcr+ (filled squares) is reported. In the inset, the interval p € [—2, 2] where the data overlap 
is magnified. The full line is the Gaussian approximation, ^(^^\p ~ 1)^- The plot shows that the 
Gaussian is not a good approximation in the interval [—2, 2]. The validity of the Fluctuation Relation 
in the same interval is shown by the overlap of the open circles and filled squares. 

Probability distribution function 

From the dataset Va the histograms tTt{p) are constructed for different values of r = utq as follows: 
the values of p{x) for r = htq are obtained by averaging n subsequent entries of the dataset Vo', 
one obtains a new dataset Vn = {p'j^^}j=i...Af/n such that p^"-* = n~^J2^=nj+iPi- Finally, from the 
dataset Vn the histogram of t^t{p) is constructed for r = nrp; the errors are estimated as the square 
roots of the number of counts in each bin. The function Ct(p) is then defined as Cr(p) — log7rT-(p). 

Shifting of the maximum 

By fitting the function Ct(p) in p G [—1, 3] with a sixth-order polynomial the position of the maximum 
Pr is determined within an error that, since 5p is the length of a bin, is estimated to be 5p/2. Then, 
the function ririj)) = Ct{p — 1 + Pt) is constructed, see Eq. (5.18); it is expected to approximate the 
limiting function Coo(p) with error 0{{p — 1)^/t). The functions 77t(p) are reported in Fig. 5.1 for 
different values of r. A very good convergence for r > 5.0 — 50tq is observed. 

By a fourth-order fit of the so-obtained limiting function Coo(p) around p = 1 the coefficients 
= -0.287 and (^'^ = 0.149 are extracted in order to test the correctness of Eq. (5.16). In Fig. 5.1 
Pr is reported. The full line is the prediction of Eq. (5.16), that is indeed verified for r > 10. This 
result confirms the analysis of section 5.2. 

Graphical verification of the fluctuation relation 

From the previous analysis one can conclude that the function r]r{p) for r = 5.0 provides a good 
estimate of the function Coo(p) for p G [—2,4] (see Fig. 5.1); thus, one can use this function to test 
the fiuctuation relation, Eq. (4.11), in this range of p. In Fig. 5.2 the estimated functions Coo(p) and 
Coo(— p) + pcr+ are reported. An excellent agreement between the two functions is observed in the 
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interval p G [—2, 2] where the data allows the computation of both Coo(p) and Coo(— p)- Note that in 
this range of p the function Coo(p) is not Gaussian, see the inset of Fig. 5.2. 

Quantitative verification of the fluctuation relation 

The translation of the function Cr(p) is crucial to obtain a correct estimate of the limit Ccx)(p) and to 
verify the fluctuation relation. In this section an attempt to quantify this observation is presented; 
as the discussion will be very technical, the reader who is satisfied with Fig. 5.2 should skip to next 
section. 

The histogram 7r„T-o {p) derived from the dataset Vn is constructed assigning the number of counts 
■Koc in the a-th bin to the middle of the binning interval, that will be called (the latter will be an 
increasing function of a). The statistical error d-K^ on the number of counts is y^Tr^. The histograms 

are constructed in such a way that if pa is the center of a bin, also —pa is the center of a bin'^ ; a is 
the bin such that Pa = —Pa- There exists a value pm such that for pa < Pm the number of counts in 
the bin a is smaller than m (m = 4 has been chosen in the present analysis). Define Pa^ the smallest 
value of Pa > Pm- Hence, the histogram is characterized by: 

1. a bin size Sp; 

2. the bin corresponding to the minimum value of Pa such that the number of counts in the 
bin is at least m; 

3. the total number M of bins such that a E [am,am]; for these values of pa, both Wrip) and 
nri—p) can be computed and they can be used to verify the fiuctuation relation. 

The function Ct{p), derived from the histogram, is specified by a set of values {Pa,Ca,^Ca) for each 
bin a, where Ca = logTr^ and the error 5(a has been defined by 

<5Ca = = ^ . (5.30) 



A quantitative verification of Eq. (4.11) is possible defining the following function: 

2_ 1 (Ca - Q<x-Voi<^+f' (r^'X^\ 



Q — rt 



The value of x is the average difference between Cr(p) and Ct{—p) + po'+ in units of the statistical 
error. Translating p of a quantity a6p/2, a^'L^ corresponds to shifting the histogram, i.e. to consider 
a new histogram (p^^ + a^p/2, Ca, (^Ca)- This preserves the property that if p^ is the center of a bin, 
also —pa is the center ofabin; let a(a) be the new value of a such that ^^((j) +a(5p/2 = — (po, + a5p/2). 
Also, the number Mo of bins such that a{a) G [am,cim{(i)] depends on a. Define 

1 (Ca - Ca(a) " (Pa + aSp/2)a+)^ 

The criterion that will be followed is that the fluctuation relation is satisfied if x ^ 3, which 
means that Coo(p) and Coo{—p) + differ, on average, by less than 3 times the statistical error 
\/ {^C{p))^ + {^(i^P))^- The function x(a) for the case of model I at = 5 is reported in Fig. 5.3. 

iThat is, either pa = (2a + l)5p/2 or — ocSpf where Sp is the size of a. bin. 
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Figure 5.3: Model I at £^ = 5: (left) the function x(a)- The full line corresponds to x = 3. The arrow 
indicates the interval 6o ± 6p/2 (note that its length is 2 in units of a) into which the minimum of 
X can be located within the accuracy of the histogram, (right) The function X{a). The horizontal 
arrow marks the interval where the minimum of x is located, see the left panel. The vertical arrow 
indicates the error 6X on the value X = 1 which is estimated as 6X = 2{X(2) — -'^(l)). The slope of 
the fluctuation relation without the translation would have been X{a = 0) ^ 0.85. 



The minimum of x is assumed between a* = 1 and a* + 1 = 2 and an upper limit for the value of x 
at the minimum is x(l) 3.5. The translation that minimizes x is estimated as Sq — {a* + 0.5)dp/2 = 
1.5 • 0.093 — 0.140, and to this estimate an error zLSp/2 is attributed, where Sp — 0.186 is the size 
of a bin. On the other hand, as discussed above, in order to shift the maximum of Cr(p) in p = 1, 
one has to translate p by a quantity S = I ~ p = 0.215. The consistency of the analysis requires that 
5 and So coincide within their errors, i.e. that the intervals S ± Sp/2 and 5q ± dp/2 overlap, or in 
other words \S — So\ < Sp. In the present case 0.075 ^ \S — So\ < Sp = 0.186, then S and Sq coincide 
within the errors. This means that the translation of p brings the maximum of Crip) in p = 1 and, at 
the same time, minimizes the difference between ?7r(p) and rir{—p) +p(7+, where rjr is the finite time 
estimate of Coo(p). The value x('^*) quantifies this difference and is a first estimate of the precision of 
the analysis. 

Another estimate of the precision of the analysis can be obtained as follows. Define a parameter 
X as the slope of Coo(p) ~ Coo(^p) as a function of ^(7+: 

Cooip) ^ Coo{-p) + Xpa+ . (5.33) 

The fluctuation theorem predicts X — 1, but other values of X are possible under different hypothesis, 
see [84, 95, 112, 129]. Defining a function x'^ia,X) as 



±_ "y."' (Ca-fe(a)-^(Pa + «W2)^+)' 

Ma ^ {SU? + (5fe(a))^ 



for each value of a one can calculate the optimal value of A", X{a), by minimizing x^{a,X\ The 
function X(a) is reported in Fig. 5.3. As the shift of the maximum S is between a = 1 and a — 2, 
the slope X is compatible with one. Moreover, as the natural error on p is the size of a bin Sp, it is 
reasonable to assign to the value AT = 1 a statistical error SX ~ 2{X(2) — ^(1)) = 0.22. Note again 
that without the translation of p the optimal slope would be AT ~ 0.85, incompatible with Eq. (4.11). 
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Discussion 

From the present analysis, one can conclude that: 

1. the translation shifting the maxininm of Ct(p) to p = 1 at the same time minimizes the difference 
between ri-r{p) and riri—p) +p(J+, where ry^ is the finite time estimate of ^oo; this proves the 
consistency of the theory of finite time corrections described above; 

2. without the translation oi p (that corresponds to a = 0), the function (rip) for r 5.0 does not 
satisfy the fluctuation relation, as x(a = 0) = 11 and X{a = 0) = 0.85; 

3. the function rir{p) = Ct{p — ^) satisfies the fiuctuation relation with x ^ 3 and an error of about 
20% on the slope X: both quantities measure the accuracy of the data analysis. 

Thus, the check of the fiuctuation relation replies crucially on the translation of the function Ct{p) 
that has been discussed in section 5.2. By considering larger values of r one could avoid this problem 
(as 6 ~ T^^); however, as one can see from Fig. 5.1, for r > 5.0 the negative tails of Ct{p) are not 
accessible to the computational resources available during this work. The computation of the finite 
time corrections is mandatory if one aims to test the fluctuation relation at high values of the external 
driving force. 

Summary of the data analysis 

To summarize, the procedure followed to analyze the data of a given simulation run is: 

1. a value of r such that Cr(p) appear to be close to the asymptotic limit Coo{p) is determined; 

2. the maximum p of Cr (p) is obtained by a sixth-order polynomial fit around p = 1, in an interval 
as big as possible compatibly with the request that the from the fit is less than 10; 

3. the histogram is shifted by an integer multiple a of the half bin size Sp/2 and the function x(a) 

is computed according to Eq. (5.32). The value a* such that the minimum of x(O') is assumed 
in the interval [a* , a* + 1] is determined: the consistency of the analysis requires that 6 = 1 — p 
and 6o = (a* + 0.5)6p/2 coincide within their errors (i.e. \d — (5o| < Sp); 

4. The value x* = iiiin[x(fl*)j x(o* + 1)] is an upper limit for the value of x at the minimum. The 
number of bins min{Ma*, Ma*+i} involved in this estimate will be called M*; 

5. the error 6X = 2(X{a* + 1) - X{a*)) is computed. 

The relevant quantities r, S, Sq, \S — So\, Sp, M* , x* and 5X for model I are reported in table 5.1 for 
different values of the external force E. 



5.5 Numerical simulation of model I 

The numerical data obtained from the simulation of model I (defined in section 5.3) will now be 

discussed systematically at different values of the driving force E. In Fig. 5.4 the mobility iJi{E) = 
T{J)e/{NE), i.e. the l.h.s. of Eq. (4.38) times T/N, is reported as a function of E. The current 
J{p,q) has been defined in Eq. (5.24). From the Green-Kubo relation, Eq. (4.36), one has [80] 
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Figure 5.4: Model I: mobility /i as a function of the driving force E. The full line is the equilibrium 
diffusion coefficient D divided by the temperature. Deviations from the linear response are observed 
around E = 5. The error bars are of the order of the dimension of the symbols. Studying /i(-E) for 
values of E bigger than those shown in the figure, one can verify that the mobility increases up to a 
value fimax, reached in correspondence of £' ~ 45. For values of E bigger than i? ~ 45, the mobility 
begins to decrease essentially following the limiting curve TJr/iNE), where Jt = y/T{d - l/N)N /T 
is the maximum allowed value of the current (saturation value). 

where D is the equilibrium diffusion coefhcient. 



Deviations from the linear response are observed and ^ D/T + 0{E^) above E = 5. 

In table 5.1 the main parameters that result from the data analysis (as discussed in the previous 
section) are reported for some selected values of E. The value (5o| is always less than Sp, consistently 
with the discussion above, except for E = 12.5 where, however, the relative difference between the 
two quantities is small 9%). It can be noted that 6 is systematically bigger than i5o. This could be 
due to the fact that the error terms 0((p — 1)^/t) or o(1/t) that have been discarded likely produce 
a systematic shift in 6 or in 6q; or that the velocity of convergence of Ct(p) is not the same on the 
negative or on the positive side (because numerically is much more difficult to observe big negative 
fluctuations of a than the positive ones - and the Fluctuation Relation provides a quantitative estimate 
of the relative probabilities). At the moment, because of the level of precision of the simulations, it 
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0.089 
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0.139 
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0.22 


7.5 
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0.116 


0.081 


0.116 


18 
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0.18 


10.0 


2.5 


4.044 


0.262 


0.151 


0.111 


0.122 


17 


4.4 


0.20 


12.5 


2.5 


7.090 


0.257 


0.137 


0.120 


0.111 


8 


3.5 


0.28 




(5.36) 



Table 5.1: Model I: results of the data analysis for some selected values of E. All the quantities are 
defined in section 5.4. For E > 12.5 the negative tails of the distribution are not accessible to the 
numerical simulation. 
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Figure 5.5: Model I: Lyapunov exponents for £^ = 5 (top) and for E ~ 25 (bottom). For each panel, 
the upper and lower dots are the two paired exponents A^^^ and and the middle dot is their 

average (A^+^ + A^. ')/2. The full line is (7+ /2Nd, the dashed line is at A = 0. 



is not possible to investigate this problem in more detail, see also Remark (3) in section 5.2.3. On 
increasing the value of E, one is forced to decrease the value of r used for the analysis as, for longer 
T, the negative tail of the distribution Crip) becomes unobservable. This can be seen as the number 
M* of bins used for the computation of x decrease on increasing E; above E = 12.5 it is impossible 
to find a value of r such that Cr(p) is close to the asymptotic limit and the negative tail is observable. 
Thus, the fluctuation relation cannot be tested above E = 12.5 with the present computational power. 
However, the fluctuation relation has been checked in the region E > 5 where deviations from the 
linear response are observed. Moreover, the estimated distributions Coo(p) are very similar to the one 
reported in Fig. 5.2: in particular, they are not Gaussian in the investigated interval of p (also for 
< 5, in the linear response regime). 

Finally, in Fig. 5.5 the measured Lyapunov exponents of the model for E ^ 5 and _E = 25 are 
reported. For this system, the Lyapunov exponents are known to be paired [125, 130, 131] like in 
Hamiltonian systems and the average of each pair is a constant equal to a^/2Nd. For E = 5, each 
pair is composed of a negative and a positive exponent. This means that the attractive set is dense 
in phase space [95, 112] and the chaotic hypothesis is expected to apply to the system yielding a 
slope X = I in the fluctuation relation, as conflrmed by the numerical data. The same happens up to 
E ^ 20. Above E — 20, there is a number D of pairs composed by two negative exponents (for E = 25 
one has D = A, see Fig. 5.5). In this situation, the slope X in the fluctuation relation is expected to 
be given hy X = 1 - D/Nd [112, 129]. Thus, for E = 25 one expects X ~ 0.75. Unfortunately, as 
discussed above, above E ~ 12.5 negative fluctuations of the entropy production are not observed, 
and this prediction could not be tested in the present simulation. 
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Figure 5.6: Mobility as a function of the temperature T and of the driving force E for Model II. 
The circles correspond to the equilibrium diffusion coefficient divided by the temperature. Deviations 
from the linear response are observed for i? > 3; they become larger on lowering the temperature, as 

5.6 Numerical simulation of model II 
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0.048 


0.085 


14 


1.7 


0.11 


1.9 


10 


0.2 


139.0 


0.079 


0.135 


0.056 


0.039 


7 


0.8 


0.10 


2.1 


6 


0.4 


40.48 


0.074 


0.110 


0.036 


0.110 


11 


1.0 


0.15 



Table 5.2: Model II: results of the data analysis for some selected values of T and E. All the quantities 
are defined in section 5.4. 

Model II differs from model I in the dimension d = 3, in the larger number of particles N — 20, 
and because it is a binary mixture of two types of particles. Binary mixtures are frequently used as 
models for numerical simulations of supercooled liquids as they avoid crystallization also at very low 
temperature on the " physical" time scales (i.e. on the time scales of numerical experiments) ; for these 
systems, at low temperature deviations from the linear response are observed also for very low values 
of the external driving force. 

In Fig. 5.6 the equilibrium diffusion coefficient D (divided by the temperature T) and the mobility 
(for different values of E) are reported as functions of the temperature. Even though the number of 
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Figure 5.7: The estimate of the function Coo(p) (open circles) for Model II with T = 1.1 and £' = 3. In 
the same plot (oo(— (filled squares) is reported. In the inset, the interval p € [—1-5, 1.5] where 
the data overlap is magnified. The full line is the Gaussian approximation, Coo(p) = \C,^ {p — 1)^. 
The data have been obtained from the histogram of iTrip) with r = 2.5 (see table 5.2). 

particles is very small, on lowering the temperature the systems approaches the supercooled state and 
D becomes very small around T 0.5. Slightly above this temperature, i.e. around T = 1, strong 
deviations from the linear response are observed for E > 3, where the entropy production cr-i- is still 
close to 0. Some values of cr+ are reported in table 5.2; to compare these values with those obtained 
for model I one should note that cr+ is an extensive quantity. Thus, the entropy production per degree 
of freedom, a+/2Nd, is much smaller in model II than in model I. 

In table 5.2 the results of the data analysis outlined in section 5.4 are reported. For E < 6 a, very 
good agreement of the data with the predictions of the fiuctuation relation and with the theory of 
finite time corrections discussed in section 5.2 is obtained. For = 10 it is very difficult to observe 
negative fluctuations of p with the available computational power; see e.g. the result of the analysis 
for E = 10 and T = 1.9, where only AI* — 7 bins where available and it was mandatory to use r — 0.2, 
of the order of the mixing time tq. In Fig. 5.7 the estimated function Coo(p) obtained for T = 1.1 
and E = 3 from the data with r = 2.5 is reported. Strong deviations from the Gaussian behavior 
are observed in the accessible range of p (see the inset of Fig. 5.7). A similar behavior of Coo(p) is 
observed in correspondence of all the values of E and T that were investigated (those listed in Table 
II): in particular in all these cases highly non Gaussian behaviors are observed in the accessible range 
of p. 

The Lyapunov spectrum for this system is very similar to the one reported in the upper panel of 
Fig 5.5. Pairs of two negative exponents were observed only for = 10 at T < 1.3, where, as in the 
case of Model I, ct+ is too large to allow for a verification of the modified fluctuation relation expected 
in this case, see the discussion at the end of section 5.5. 

5.7 Discussion 

The fluctuation relation has been tested, quite successfully, in a numerical simulation of two models 
of interacting particles subjected to an external nonconservative force and to a reversible mechanical 
thermostat. The data satisfy the fluctuation relation with a % < 3 and an accuracy of the order of 
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20% also for very large values of the driving force, where strong deviations from the linear response 
are observed, and where the large deviation function is strongly non-Gaussian. The comparison of 
the numerical data with the predictions of the fluctuation relation is done by taking into account 
the (lowest order) finite time corrections to the distribution function for the fluctuations of the phase 
space contraction rate. This is crucial: if such corrections were not taken into account, the fluctuation 
relation would be violated within the precision of the experiment. 

In order to compute the finite time corrections, an algorithm which allows to reconstruct the 
asymptotic distribution function from measurable quantities at finite time, within a given precision, 
has been proposed. The theory of the corrections relies on the symbolic representation of the chaotic 
dynamics, therefore it is applicable if one accepts the Chaotic Hypothesis. 

The numerical results support the conjecture that the chaotic hypothesis can be applied to these 

systems, also very far from equilibrium, and in particular the fluctuation relation is satisfied even in 
regions where its predictions measurably differ from those of linear response theory. 

The theory of finite time corrections for the analysis of the numerical data could in principle be 
of interest for real experimental settings where non Gaussian fluctuations for the entropy production 
rate are observed, see e.g. [103, 106]. 

However it should be stressed that in a real experiment there are some technical diff'erences with 
respect to the numerical simulation which could in some cases make inapplicable the analysis, namely: 

(i) usually the noise in the large deviation function for the entropy production rate in a real experi- 
ment is much bigger than in a numerical experiment, and it is likely that the translation in Eq. (5.18) 
computed as the ratio (^(3)/((^(2)^2 -g measurable within an error of some percent; 

(ii) usually in a real experiment the accessible time scales are naturally much bigger than the micro- 
scopic ones so that, if the negative fluctuations of the entropy production rate are observable at all, 
one is automatically in the asymptotic regime, where the finite time corrections should be negligible; 
(Hi) a usual problem in a realistic setting is that there is no clear connection between the "natural" 
thermodynamic entropy production rate s = W/T [W is the work of the dissipative external forces 
and T is the temperature) and the microscopic phase space contraction rate, for which a slope X = 1 
in the fluctuation relation C,{p) — C(— p) = X(j-^.p is expected; so, often one measures anX ^1 and cor- 
respondingly one defines an effective temperature Qeff = T/X giving a natural connection between 
the effective thermodynamic entropy production rate Sp/j = W/ &,,]'/ and the phase space contraction 
rate, see [84, 103, 106] and the following chapters; in such a situation (where an adjustable parameter 
X appears) it makes no sense to apply this analysis, which is sensible only if one wants to compare 
the experimental data with a sharp prediction about the slope X in the fluctuation relation. 

A big problem which is loft open is trying to understand how the fluctuation relation is modified 
for values of the driving force so high that the attractive set is no longer dense in phase space. It 
is expected, [129], that in such a case Coo(f>) — Coo{—p) is still linear, but the slope is Xa+, with X 
given by the ratio of the dimension of the attractive set and of that of the whole phase space. An 
estimate of such quantity can be given via the number of negative pairs of exponents in the Lyapunov 
spectrum [112, 129]. Unfortunately negative pairs begin to appear in the Lyapunov spectrum only for 
values of the external force so high that no negative fluctuations are observable anymore. Hopefully 
future work will address this point. 
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5.8 Appendix: A Limit Theorem 

In this section Eq.s (5.9-5.10) will be proved. The proof is presented in the case p is the average of 
independently distributed discrete variables erf, assuming values in eZ, for some small mesh parameter 
e; then how this can be applied and adapted to the situation considered in section 5.2 and subsequent 
sections will be discussed. 

Let cTj, i e N, be independent continuous random variables with identical distributions n{dai) 
with positive variance Sa^ > 0, supported on the finite interval [.s_,s+]. Assume that TT{dai) gives 
positive probability to any finite interval contained in [s_, s+]. Let nxlda) bo the weighted distribution 
TTx{da) = e-^'^n{da)/ J e'^'^TTida) and define Zoo(A) = - log/ e-^'^7r(dcr) and a+ = z'^{0). Note that 
the assumption that 'K{dai) gives positive probability to an interval of a in [s_,s+] impUes that for 
any finite A also Tr\{da) has positive variance — ^^(A) > 0. 

Also, given e > (with the property that s+ — s_ = N^e for some integer A^^), consider the 
discretization of <7i on scale e, and call it a^: will be a discrete variable assiiming the values 
s| = s_ + (A; — i)e, k = l,...,Ng, with probabilities 7r^(s|) = Prob(c7| = s|) = Jgej.eTr{da). 
The assumption that ■iT{dai) gives positive probability to any finite interval contained in [s_,s+] 
implies that 7r^(s|) > for any s and k. Let also Ze{X) = — logX^^^ e~'^*^7r^(s|) and 7r|(s|) = 
T^^{s%)e~-^^^''~^^^'^'^\ Note that, since 7r^(s|) > for any k, for any finite A one has — z"(A) > 0. 

If = o"! and Ilr{e;I) is the probability that p^ belongs to the finite interval /, the 

following theorem holds. 

Theorem: Given a finite interval I C (s_,s+), let af, and JIr{e;I) be defined as above. Then, 
for a sufficiently small £ > 0, there exists an analytic "rate function" Ct{p) s«c/i that 

lim Jk(£iiL = 1 . (5.37) 



Ct{p) is defined by: 



1 



T 



Jj dpe-^i^'^p') 



smh[eXl/i2a+) 



sXi/{2a+) 



^ 2./ /'(An ^^-^^^ 
CiP) = -zeiK) + - ^ iog[ V ( ^ ^ 

and \p is the inverse of p{X) = z'g{X)/a+. The function Ct(p) the following property: if A C I is 
an interval of size around a point pa, then: 

Proof Define the auxiliary variable q = J2l=i Vit where r]i are i.i.d. discrete random variables, 
with distribution 7r|(s|). Let n^(e;(7o) be the probability that q assumes the value go <= I, with 
qocr+ = sI/t for some A: £ N, and note that Il'^{s;qo) is identical to the probability that Pr = qo- By 
definition 11:^ (go) and n°(go) are related by: 

Now, a local form of central limit theorem (Gnedenko's theorem, see pag. 211 of [132]) tells that, if 
q is localized near its mean value, that is if \qa+ — z'^{X)\ < ^ for some finite M, then n^(£; go) is 
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asymptotically equivalent to the Gaussian with mean Zg(A) and variance —z'J{X), in the sense that 

n^(go) = , „, e-~ -'-y'^" "(1 + 0(1)) , (5.41) 

^27rr(-4'(A)) 

for any go s.t. \qa+ - z'^{\)\ < ^ \ 

So, given A^^^ s.t. z'^(X^^) — qo(y+ (such A^^^ exists, is unique and is an analytic function of qo, by 
the remark that — z"(A) > for any finite A and -Ze(A) is an analytic function of A), using Eq. (5.41), 
Eq. (5.40) can be restated as: 

n°{e;qo) = ^ =e^°^o^°"+^-^-(^^oHl+o(l)) • (5.42) 

/27rr(-4'(A-,J) 



Now, by the definition of Cr(p) in Eq. (5.38), the r.h.s. of the last equation is equal to ■;p^e'^''^^'^°\l + 
o(l)). Finally, the statement of the Theorem follows by the remark that 



.e^C?(Po) 



r°^'^'+ dpe^^-^P'^ (l + o(l)) . (5.43) 



rcr+ 

In fact the integral in the r.h.s. of the last equation is given by 



_crC.fan^ 2sinh[C;(po)£/(2a+)] / ^ C"(po)£^ >. 

tCUpo) ^ ^ T V 



(5.44) 



<Upo) 

and in the last expression one has to note that Ct(Po) = [Ct]'(Po) + = Xp^ + 0(i). ■ 

A first Remark to be done about the Theorem above is that, in order to define a "universal" rate 
function in terms of quantities depending only on z^o (A) (instead of quantities depending on the "non 
universal" function Zs{X), which explicitly depends on the discretization step e), it would desirable 
to perform (in a sense to be precised) the continuum limit £ — > 0. To this regard, one can note that 
the only point where in the proof above the fact that e is a constant (i.e. is independent of r) has 
been used was in using Gnedenko's Theorem, see [132]. However, by a critical analysis of the proof of 
Gnedenko's Theorem, one can realize that it is even possible to let e = go to with r; the velocity 
with which Sr is allowed to go to depends on the details of the distribution it {da). So one can even 
study the probability distribution of Pr on a scale er/r: introducing bins A^- of size 0{er/T) and 
defining IIt{^t) to be the probability that Pr = belongs to the bin centered in po, one 

can repeat the proof above to conclude that 



1™ , , = 1 (5.45) 



where Cr satisfies the equation: 



Cr(p) = -z^{Xp) + Xppa^ - ^ log[- ( - f^l^)] (5.46) 



Note that Gnedenko's Theorem is different from the usual central limit theorem, stating instead that for \q(7+ — 
z'e{^)\ ^ (C big) the sums of Il^(e;q) over intervals of amplitude contained in \qcr^ — z'^(X)\ < are 

asymptotically equal to the integrals of the Gaussian over the same intervals. That is, usual central limit theorem gives 
informations on the distribution in a bigger interval around the maximum, but on a rougher scale. 
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and Aj, is the inverse of p{X) = z'^{X)/a+. 

Another point to be discussed is that in the Theorem above the C7j were assumed to be indepen- 
dent. This is not the case for the variables cr(S''-) of section 5.2. However, if, as discussed in Remark 
(3) of section 5.2.3, the time unit is chosen to be of the order of the mixing time, the variables cr(S'*-) 
have (by construction) a decorrelation time equal to 1, and the analysis of previous theorem can be 
repeated step by step in order to construct the probability distribution of p = ^i'^i^^')- The only 
differences are that: (1) tz^{X) should be replaced by tZt{X} = — log/ e~^P'^+^'n.T{dp) throughout 
the discussion; (2) instead of Gnedenko's theorem one has to apply a generalization of Gnedenko's to 
short ranged Gibbs processes, to be proven via standard cluster expansion techniques (sec for instance 
[133] for a proof of a generalization of Gnedenko's theorem to a short ranged Gibbs process in the 
context of non critical fluctuations of the phase separation line in the 2D Ising model). 

The conclusion is that, if the bins A in section 5.2.2 arc chosen of size Sr/r, the probability of the 
bin A centered in is asymptotically given by 7r(p G A) ~ pjC^ip^) (in the sense of Eq. (5.9)) and 
Ct(pa) can be interpolated by an analytic function of p that in fact satisfies Eq. (5.10). 
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Chapter 6 

Dynamics of glassy systems 



6.1 Introduction 

From a phenomenological point of view the dynamical behavior of glassy systems is more relevant than 
the equilibrium one [134]. Indeed, as discussed in chapter 1, the equilibrium relaxation time diverges, 
on approaching Tk from above, following the VFT law (1.1). This divergence is much stronger than 
the power law that characterizes second-order phase transitions, and this means that the relaxation 
time becomes much larger than any experimentally accessible time scale at a temperature Tg that is 
usually much larger than Tk- Indeed, the ratio j, _ , related to fragility, falls between 1 and 10 in 
molecular glasses-'^, see section 1.1.1. 

Below Tg the system cannot be equilibrated anymore, so its equilibrium properties cannot be 
investigated and in particular the Kauzmann transition and the ideal (equilibrium) glass phase are 
unobservable. The system becomes a real (nonequilibrium) glass whose properties are not described 
by the Gibbs distribution. The real glass transition is a dynamical phenomenon, so that almost all the 
experimental data (apart from the extrapolations discussed in chapter 1) refer to dynamical properties 
of the nonequilibrium glassy state. The most striking feature of the nonequilibrium glassy state is that 
it is not stationary: even if the averages of the interesting observables (pressure, density, etc.) reach 
an asymptotic constant value, the two-time correlation functions C{t, t') depend on the two times also 
for t,t' very large (i.e. of the order of the experimentally accessible time scales). This phenomenon is 
known as aging, because the properties of the system depend on its age, i.e. on the time elapsed from 
the initial time in which it was prepared. 

Thus dynamical theories of glasses are more suitable to be compared with experimental data. 
Indeed, many theories have been proposed, either phenomenologicals or fundamentals, and many 
experiments have been performed, so that a very large literature about the dynamical behavior of 
glasses exist, and detailed reviews have been recently published, see e.g. [24, 27, 28, 134, 135, 136, 
137, 138, 139]. Some aspects of the equilibrium dynamics of glasses have been discussed in chapter 1. 
In the following some selected aspects of the nonequilibrium dynamics will be discussed. Only a 
particular point of view, that derives from the exact solution of the dynamics of p-spin models, will 
be discussed, and the attention will be mainly focused on the driven dynamics, i.e. the dynamics in 
presence of nonconservative forces, because in next chapter an extension of the fluctuation relation to 
driven glasses will be discussed. 

^In numerical simulations the accessible time scales are much smaller than in experiments, so the Tg of numerical 
simulations is much higher than the experimental one. 
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6.2 Relcixational dynamics of ]9-spin models 

Following the strategy of [140, 141], the dynamics of mean field p-spin systems can be analytically 
solved [21]. Detailed reviews are in [28, 24]. 

The Hamiltonian of p-spin models is given by Eq. (1.10). If the spherical version is considered, the 
variable <Jk are continuous and the simplest possible dynamics is the Langevin dynamics: 

&k{t) = -IJi{t)<Jk{t) - + % W + hk{t) , (6.1) 

where r]k{t) is a Gaussian white noise, with {r]k{t)) = and {T]k{t)'ni{t')) = '^T5u5{t — t'), ii{t) is a 

Lagrange multiplier that is needed to enforce the spherical constraint '^i^cr'^ = N, and hi.{t) is an 
external field that will be used only to compute the linear response, see below. For Ising systems the 
Metropolis dynamics can be considered but the calculations are more complicated. 



6.2.1 Dynamical generating functional 

The average of a given observable A, which is a functional of the trajectory (T{t), is given by 

{A) = J Va{t)V[a{t)]A[a{t)] , 



(6.2) 



where 'P[(j{t)] is the probability distribution on the space of trajectories induced by the distribution of 
the noise and by the equation of motion (6.1). Examples of interesting obscrvablcs are the magneti- 
zation m{t) = N~-^ {(^k{t)) and the correlation function C(t,t') = {<yk{i)<^k{i')) ■ Another 
interesting observable is the linear response function, defined by 



Hsk{t)) 



Shkif) 



(6.3) 



h=0 



To compute the average of one-time observables A{t), such as the magnetization, one can introduce 
a dynamical generating functional 



J dtJ{t)A{t) 



(6.4) 



The average of A and its correlations can be computed as derivatives of Z w.r.t. to J{t). Note that 
as long as 7'[(T(t)] is normalized Z[J = 0] = 1 and one does not need to consider the logarithm of Z. 

Moreover, one can simply compute Z[J = 0] (which is trivially 1) in order to see which trajectories 
a{t) dominate the generating functional for TV — > oo. As the system is mean-field, this procedure 
allows to write effective equations for a single degree of freedom moving in an environment whose 
properties have to be determined self-consistently. If the initial condition is chosen at random, one 
has simply [24, 28]: 

dHp{a) 



1 = J Vait)V[a{t)] = J Va{t)Vr,{t)V[r,{t)]5 
and since the distribution of the noise is a Gaussian, 

--E 

AT ^ 



'P\t](t)\ oc exp 



a-fe(t) +M(t)o-fe(i) 



dtr\k{tf 



dak{t) 



-Vkit) 



one can easily perform the integration over r]{t) in Eq. (6.5) representing the (5-function as 

5[fk{t)\ oc j TO(f)eSfc/<i"^'= (*)/»=(*) , 



(6.5) 



(6.6) 



(6.7) 
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and one finally obtains 

locy'pa(0©?(Oe"^^^-^*"'^*''+^^-^''*"'^*^["'^*^+''^*^"'^*^^^] = jva{t)Va{t)e^^-'''^ . 

(6.8) 

The procedure that leads to Eq. (6.8) holds for a generic Langevin equation. The action S{(7, a) has 
a term proportional to —a^ whose coefficient is 1/2 times the variance of the noise, a term iaa and a 
term —iaF{a), where F{a) is the force acting on a. What is remarkable is that the proportionality 
factors in Eq.s (6.6), (6.7), (6.8) do not depend on the couplings J, i.e. on the disorder. This means 
that the disorder appears (linearly) only in the exponent of Eq. (6.8) and one can now perform the 
average over J without using replicas. Another interesting remark is that the response function R(t, t') 
is just the correlation function of ia and a, R{t, t') = Ylik {(^k{t)i^k{t')) [24, 28]. 

6.2.2 The average over the disorder 

Averaging over the' disordcT in Eq. (6.8) simply amounts to perform the Gaussian integral 



The effect of the average over the J is to produce nonlocal terms, because in the expression above 
terms of the form exp[J / dtf{t)] appear. After the integration over the (Gaussian) J, they give rise 
to terms of the form exp[J dtf{t)]'^ = exp[J dtdt' f{t)f{t')], which is a nonlocal term. 
Without entering into the details of the computation, see e.g. [24], the final result is 



/ dtta,{t)!^i^ ^ g^^^^ / dtdt'R{t,t')Rit',t)C{t,t'r-^ _ (g_;^g^ 

What is important is that the latter expression depend on a, a, only through R{t,t') and C{t,t'), 
which are macroscopic observables. This is what usually happens in mean-field systems. Substituting 
this result in Eq. (6.8), one can follow the usual procedure of introducing (5-fimctions, for example 
6[C{t,t') — ./V^^ CTi(t)ai(t')], in order to rewrite Eq. (6.8) in the following form, see [24] for the 
details: 

1 = J VC{t, t')VR{t, t') e^^^ / dtdt'Rit,t')Rit',t)c(t,t'r-^ ^ 
X J VaVae^''^^*^*'i~i'^^^'*'^''~''^'''^*^^''^^'^~iP^P~'^^^^^^^^^ (6-11) 



X e 



-T E fe / dtak (tf+T, k I dt iak (t) [&k {t)+^l{t)ak (t)] 



Comparing the last two lines of the latter expression with Eq. (6.8), it turns out that the spins (7^ 
are now decoupled; and the last expression for the generating functional could be obtained from the 
effective equation for the dynamics of the spin ak'- 

&{t) = -t^{t)a{t) + ]-p{p-l) [ dt'R{t,t')C{t,tr-Mt')+p{t) , 

^ J (6.12) 

{p{t)p{t'))=2T5{t-t') + ^-C{t,t'Y-^ . 

Thus, the original interacting problem has been mapped into a single-spin problem, with a nonlocal 
force and a noise which is not simply J-corrclatcd. Turning back to Eq. (6.11), the integration over 
the functions C{t,t') and R{t,t') can be performed via a saddle-point evaluation. The saddle point 
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equations are simply^ 

CM = {ait)ait')) , 



5h{f') 



(6.13) 

= Ht)id{t')) , 

h=Q 



where the average is now over the dynamics generated by Eq. (6.12) and the field h{t) must be added to 
Eq. (6.12) to compute the response. This means that C and R have to be determined self-consistently 
as the correlation and response function for the effective equation (6.12). This procedure makes clear 
that C{t,t') (and eventually R{t,t')) are the dynamical order parameters, as already discussed in 
section 1.1.6. Restricting to causal solutions, such that R{t,t') — for t' > t, the self-consistency 
equations can be written starting from Eq. (6.12), see [24, 28], and are (for t > t') the following: 



dtC{t,t') = -n{t)C{t,t') + ^p(p- 1) j dt"R{t,t")C{t,t"f-^C{t",t') + dt"R{t',t")C{t,t' 
dtR{t, t') = -tJ.it)R{t, t') + ^p{p -I) j dt"R{t, t")C{t, t")P-^R{t", t') + 6{t - t') , 
^(t) = T + ^ j dt'R{t,t')C{t,t'f-'^ . 



"\p-i 



(6.14) 



The equation for n{t) is obtained from the condition ■^C{t, t) = 1 that follows from the spherical con- 
straint. Note that, once the self- consistency equations are solved, C{t, t') and R{t, t') are determined 
and the dynamics of each spin ak is given by Eq. (6.12), which is a Langevin equation for a single 
spin moving in an effective environment defined by C and R. 



6.2.3 The dynamical transition and aging 

As already outlined in section 1.2.1, Eq.s (6.14) admit a stationary solution for T > T^. This means 
that one can find a solution such that /z(t) = C(t, t') = C(t — t') and Rit, t') = R{t — t'). Moreover, 
C and R are related by the equilibrium fluctuation-dissipation theorem, 

Rit - t') = J-^^^dtCit - t') , (6.15) 

so C{t) is the only independent variable. This means that the system is able to equilibrate with the 

thermal bath in a finite time. The relaxation time of the correlation function C{t), t^, grows on 
lowering the temperature and diverges as a power law for T T^. Slightly above Td, the dynamics 
is separated in a "fast" relaxation, that makes C{t) decrease from 1 to some value < 1 on a time 
scale which is T-independent, and in a "slow" relaxation, that makes C{t) drop to zero on a scale 
(see the curve for e = in Fig. 6.1 below), which is strongly T dependent and diverges at as stated 
above. 

Below Td the stationary solution does not exist anymore. One finds a solution that is not stationary, 
and has the form 

C{t,t') = Cfit-t') + C,{t,t') , 

(6.16) 

R{t,t' ) = Rf{t - t') + Rs{t, t') , 

^The saddle point equations cannot be derived differentiating Eq. (6.11) because some assumptions have already 
been done to obtain it, namely that P{t,t') = {a-(t)(f(t')) = 0. This assumption is related to causality. But one should 
first differentiate w.r.t. P{t,t') to obtain the equation C{t,t') = (a{t)a{t')), and then set P = 0. The equation for 
R{t,t') is obtained differentiating Eq. (6.11) w.r.t. R{t,t'). 
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while ii{t) still is asymptotically constant for t ^ oo. The stationary part of the correlations still 
describe the "fast" relaxation from 1 to g^, that is very similar to the one observed above T^. However 
the "slow" relaxation becomes non stationary below T4. In particular, if one looks to C{t,t') as a 
function oir = t — t' for fixed t', it decays to zero for t ^ Ta{t'), where Ta{t') is an increasing function 
of t' that diverges for t' ^ 00. 

Remember that Eq.s (6.14) describe the relaxation of the p-spin model starting from a random 
initial condition. This means that, if the system is prepared in a random configuration and let evolve 
in contact with a bath at temperature T < Td, it is not able to equilibrate with the bath. Moreover, if 
at time t' after the preparation the system is in a configuration cr(t'), the time needed to decorrelate 
completely from the configuration a{t') is an increasing function of t', Ta{t'), that diverges for — > 00. 

6.2.4 Interpretation of the dynamics in term of the free energy landscape 

The limit 

qd{T)= lim lim lim C{t,t') , (6.17) 

is finite for T < Td and represents the dynamical order parameter as discussed in section 1.1.6. 
This means that if one waits a long time t' after the preparation, the system is no more able to 
decorrelate completely. It remains trapped in a group of configurations a that have overlap > qd 
between themselves, i.e. it remains trapped into a metastable state. 

As discussed in section 1.2.2, for Tk <T < Td, an exponential number of metastable states can be 
found in p-spin models. For a given temperature T < Td, their free energies range from fmin to fmax- 
Starting from a random initial condition means that the system starts with a very high free energy. If 
it is let evolve at T < T^, it will start to descend in the free energy landscape until it reaches the level 
fmax where metastable states first appear. Indeed, slightly above fmax the phase space of the system 
is still connected, so the stationary points of the free energy must have some negative eigenvalues 
corresponding to unstable directions. However, the largest negative eigenvalue in stationary points is 
A (x fmax — f [20, 142]. Thus, the system remains trapped for a long time close to stationary points 
of / before it can escape and find states that are closer to fmax\ the latter have even smaller negative 
eigenvalues, so the time needed to escape from them is larger [28, 143], and so on. This is why the 
correlations become non stationary and the system ages indefinitely. 

A confirmation of this scenario is that the value of qd{T) computed from the dynamics is equal 
to the self overlap of the threshold states, i.e. the states with / = fmax, computed from the TAP 
equations. Another confirmation is that, if one studies the dynamics starting from an equilibrated 
initial datum^ at temperature T < Td, one finds a stationary solution C{t — t') which however do 
not decay to zero but has a finite limit for t — t' ^ 00. That is, equilibrium configurations below 
Td typically belong to a metastable state, so if one starts in one of them, the system remains forever 
trapped into the state. The limit q{T) = limt-t' ^00 C{t — t') is the self overlap of the equilibrium 
states at temperature T. 

6.3 Driven dynamics of ]9-spin models 

In presence of a driving force, at the mean-field level, aging disappears: the system always reaches a 
stationary state for t ^ 00. This happens because the drive makes the system escape from the trapping 

•^This is analytically possible but requires the introduction of replicas to describe the initial datum. It is impossible 
in experiments because the system cannot be equilibrated below T<j. 
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Figure 6.1: (From [146]) Correlation function vs. time for Eq.s (6.18), (6.21) with k — p = 3 and 
T = 0.613 > rd(~ 0.6124) for different driving forces. From left to right: e = 5, 0.333, 0.143, 0.05, 
0.0158, 0.00447 and 0. The longest plateau corresponds then to the undriven case. 

regions around the threshold. Moreover, many interesting phenomena that are observed when glassy 
systems are subjected to driving forces, e.g. shear forces, can be reproduced by mean-field models. 

6.3.1 Dynamical equations for driven systems 

Eq.s (6.14), which describe the relaxational dynamics of the p-spin spherical model, are particular 
instances of a general class of dynamical equations {mode- coupling equations) of the schematic form 



These equations can be obtained from mean field disordered models as described above [24, 27, 28] 
or applying resummation schemes to non-mean field ones [28]. They are often used to describe the 

dynamics of supercooled liquids and glasses, as they can be derived also from the memory function 
formalism with suitable approximations [25, 135, 136]. In general, the kernels D{t,t') and S(i,t') are 
functionals of the correlation and response fmictions. Within the mode- coupling scheme, they become 
ordinary functions of C{t,t') and R{t,t'). For the p-spin spherical model one has D{C) = |Cp~^ and 
T,{R,C) = ^p{p — 1)RC^~'^ = RD'{C). In describing realistic systems in finite dimension, a wave 
vector dependence must be introduced in Eq.s (6.18) and the kernels D and S will couple different 
wave vectors*. 

It can be proven that if the forces in the original Langevin equations describing the interacting 
system are conservative, so that detailed balance is verified, the relation T,{R,C) = RD'{C) must 
*This is where the name mode-coupling equations come from. 




(6.18) 



which correspond to an effective Langevin equation of the form 



a{t) = -ii{t)a{t) -h / dt'Y.{t,t')a{t') -\- p{t) 



(6.19) 



{p{t)p{t'))=2T5{t-t') + D{t,t') . 
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Figure 6.2: (From [146]) a-relaxation time as a function of drive for temperatures (from bottom to 
top) T = 0.9, 0.8, 0.7, 0.64, 0.62, 0.613, ~ 0.61237, 0.6115, 0.58, 0.45, 0.3, 0.01. Full lines are for 
temperatures above T^, the dashed line is T = T^, and the dotted lines are for T <Td. 



hold [144]. If S(i?, C) 7^ RD'{C), Eq.s (6.18) describe a driven system in which detailed balance is 
violated [145, 146]. 



6.3.2 A driven p-spin model 

A particular instance of Eq.s (6.18) with E(i?. C) RD'{C) was studied in [145, 146]. It correspond 
to a driven p-spin model, whose dynamics is defined by Eq. (6.1), where now hj{t) represents an 
external driving force, which cannot be written as the derivative of a potential, and is given by 

" (fc- 1)! 51 "^J'Ji-- -J^-i^Ji ■ ■ ■ ^jk-i > (6-20) 

ji,--- ,]k-i 

and J are independent random Gaussian couplings, which are also independent from the ones of the 
Hamiltonian, and have variance k\J^ /{2N'^~^). They are symmetric in the exchange of two indices 
ji, but are not symmetric in the exchange j <-» ji. These equations correspond to Eq.s (6.18) with 

2 2 (6.21) 

i: = -pip-l)RC'>-^ , 

so the detailed balance condition S(_R, C) = RD'{C) is violated by a term proportional to e^. In 
[145, 146] it was shown that these equations admit a stationary solution C{t — t'), R{t — t') for all 
temperatures. Close to (which is the dynamical transition temperature for e = 0) and for small 
driving force the correlation and response function can be decomposed, as in Eq. (6.16), in two parts 

CU - t') ^ Cf(t - t') + Cs(t- t') , 

^ (6.22) 
R{t - t') = Rf{t - t') + Rs{t - t') , 

corresponding to a "fast" and a "slow" relaxation which are well separated around and for e ~ 0, 
see Fig. 6.1. The fast relaxation depends weakly on the driving force and on the temperature. The 
slow relaxation time, in absence of drive, would diverge for T — > Tf; in presence of drive, however. 
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Figure 6.3: (From [146]) 2D view of the glass transition. Curves bent to the left are the iso-ta, curves 
bent to the right are the iso-X (see text). The critical temperature is indicated by the arrow. Times 
are = 5, 10, 25, 50, 5000 (from top to bottom), and X = 0.4, 0.5, 0.6, 0.7, 0.8, 0.9, 0.99 (from 
left to right). 

it remains finite also for T < Td- For T > Td, a strong dependence on e of the relaxation time Tq, is 
observed. Below Td, one has \im.^^QTa{e,T) = oo, so the relaxation time diverges (again as a power 
law) if the driving force is sent to zero. The relaxation time Ta{e, T) is reported in Fig. 6.2. 

6.3.3 Temperature-drive "phase diagram" 

If one plots the iso-r^ curves in the plane (e,T), see Fig. 6.3, a temperature-drive "phase diagram" 
can be obtained [146, 147]. At zero drive, the system is in equilibrium above Td (marked by an arrow 
in Fig. 6.3) while below Td it is out of equilibrium and ages. The aging dynamics, as discussed above, 
happens slightly above the threshold level fmax{T) in the free energy landscape. The system is not 
able to penetrate below the threshold because it is trapped by infinite-lived metastablc states. 

In presence of drive, the system becomes stationary for all temperatures and driving forces, so it 
reaches a nonequilibrium stationary state. This is because, for T < T^, the system lives above the 
threshold also in absence of drive. Thus, an arbitrary small drive, that continuously injects a small 
amount of energy into the system, is enough to give to the system the freedom to explore the free 
energy landscape without being trapped by the metastable states. This behavior is due to the mean- 
field nature of the model, that gives also a dynamical transition Td > Tk and power-law divergences 
of Ta on approaching the line (e = 0, T < T^). The expected behavior for finite dimensional systems 
will be discussed later. 

6.4 The effective temperature 

To summarize, the analytic solution to the relaxation of mean-field glassy models following a quench 
into their glassy phase (i.e. below T^) demonstrates that their relaxation occurs out of equilibrium [28, 
140, 141]. The reason why these models do not reach equilibrium when relaxing from a random initial 
condition is that their equilibration time diverges with their size. Thus, when the thermodynamic limit 
is taken at the outset of the calculation, all times considered are finite with respect to the equilibration 
time. These systems approach a slow nonequilibrium regime in which one observes a breakdown of 
stationarity, see Eq.s (6.16). A small enough driving force is enough to restore stationarity at all 
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temperatures. 

In the aging regime below as well as in presence of the driving force a violation of the fluctuation- 
dissipation theorem, that relates spontaneous and induced fluctuations in thermal equilibrium, is 

observed. The eflFective equation (6.19) that describes the dynamics of a single spin in the mean 
field of the others is indeed a Langevin equation that describes for instance the Brownian motion 
of a particle in an environment defined by the functions D and S. If these functions arc stationary 
and verify the detailed balance condition T,{R, C) = RD'{C), and if R and C verify Eq. (6.15), they 
describe an equilibrium environment, i.e. a thermal bath at a well defined temperature T. 

If R and C do not verify Eq. (6.15), and/or if T,{R,C) ^ RD'{C), the environment is not at 
equilibrium, which means that the spin a exchanges heat with a reservoir that does not have a well 
defined temperature. In the following, the precise condition for a thermal bath to be in equilibrium, 
as well as the definition of an effective temperature for a nonequilibrium bath will be discussed, and 
the results applied to Eq. (6.19). 

6.4.1 The fluctuation-dissipation theorem 

The fluctuation-dissipation theorem states that for systems evolving in thermal equilibrium with 
their equilibrated environment the linear response is related to the correlation function of the same 
observable, see e.g. [137] for a recent review. 

The linear response x of a generic observable O measured at time t to a constant infinitesimal 
perturbation h applied since a previous ' waiting- time'^ t', and the correlation between the same 
(unperturbed) observable measured at t and t', are defined as 



i^(M') - '^^^^^^ 



6h{t') 

x(*,o./;*"«(M")=/;<i*"^ 

c(t.t'}s{0{t)0(t'y, , 



h=0 

(6.23) 

h=0 



where, for simplicity, it was assumed that the observable O has a vanishing average, {0{t)) ~ for all 
t. In the cases that will be discussed in the following the relation between these two quantities takes 
the form 

Hin x(i,i')=x[^?(t,0] , (6-24) 

t>t'^To 

in the long waiting- time limit after the initial time Iq. This equation means that the waiting- time and 
total time dependence in x enters only through the value of the associated correlation between these 

times. This is trivially true in stationary states since C{t — t') and x{t ~ t') depend only on the time 
difference t = t — t' , so one can invert^ the function C{t) and write x(C) = x(^(C)). If the system is 
in equilibrium, the fluctuation-dissipation theorem states 

X{C) = ^[C{0)-C], (6.25) 

for all times t > t' > tgq, where tgq is the "equilibration time", T is the temperature of the thermal 
bath (and the one of the system as well) and the Boltzmann constant has been set to one, ks = 1. 

^Experimentally t' is usually the time elapsed from the preparation of the sample, i.e. at time to = the systems is 
prepared in some way, and then it is let evolve in contact with the bath. The preparation of the sample is modeled by 
the random extraction of the initial data in Eq. (6.19). 

®At least in the relaxational regime (large t) the function C{t) is usually a decreasing function of t. Oscillations 
might be present in C but only at short times. 
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An equivalent form of the fluctuation- dissipation theorem is 

= ^Zifl.rw-o -«(.),. (e.2e) 

The second expression follows from the fact that C{t) is an even function of t from its definition (and 
C{t) is odd) defining also ^(0) = 1/2 (the same convention is used in the following). After Fourier 
transforming the second expression becomes 

ujC{uj) = 2TImR{uj) , (6.27) 

and the real part of R{lo) is related to Im R{lu) by the Kramers-Kronig relation. 



6.4.2 A (driven) Brownian pEirticle in a generic environment 

To illustrate the basic concepts, that will be useful also in the following chapter, a simple Langevin 
equation of the form (6.19) will be discussed'' [139]. It describes the random motion of a particle in a 
confining potential in dimension d, in contact with a thermal environment, and under the effect of a 
driving external force, and reads 

f°° 5V(r] 
mf„(t)+ / dt' g„0{t-t')r0it') = ~-^+p„{t) + ha{t) , a=l,...,d. (6.28) 

r — (ri, . . . , rd) is the position of the particle, m is the mass of the particle and V{r) is a potential 
energy. All analytical calculations are done in the simple harmonic case, V{f) = | with k the 

spring constant of the quadratic potential. p{t) is a Gaussian thermal noise with zero average and 
generic stationary correlation 

{poc(t)p0{t')) = 5^pv{t-t') a,f3 = l,...,d , (6.29) 

with ^{t — t') a symmetric function of t — t' . The memory kernel gapit — t') extends the notion of 
friction to a more generic case. A simple spatial structure, gaf3{t — t') = Saf3 g{t — t') will be assumed. 
In order to ensure causality g{t — t') is proportional to 6{t — t'). The initial time to has been taken 
to — oo. h{t) is a time-dependent field that will be either used to compute the linear response or 
represents the external forcing. 

Eq. (6.28) is analytically solvable in the simple case in which there are no applied forces and the 
potential is quadratic. In the following it will be useful to use Fourier transforms to solve the linear 
Langevin equation, with the conventions 

/oo J f- oc 

^ e--* p{uj) , p{^) = / dt e-* p{t) . (6.30) 

-oo J — oo 

In the harmonic Brownian particle problem with no other applied external forces the dynamics of 
different spatial components are not coupled. Thus, without loss of generality, one can focus on = 1. 
In Fourier space, the Langevin equation reads 

—miJ^x{ijj) — iu)g{ijj)x{ijj) = —kx{ij) + p{ij) (6.31) 

with the noise-noise correlation 



( p{lo)p{uj') ) = 2TrS{uj + uj')iy{uj) . (6.32) 

'^In the following the attention will be focused on the stationary case. Some of the results that will be described hold 
also for the nonstationary case if the formulae are suitably adapted. 
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(6.34) 



The linear equation (6.31) is solved by 

x{uj) = G{io)p{io) , G{uj) = 2 ^ ( ^^i. ' (6-33) 

—muj^ — lojgyijj) + k 

and one finds the correlations 

{x{ijj)x{u)')) = G{ui)G{-uj)2-k6{u) + oj')v{u)) , 

{ x{uj)p{uj') ) = G{ij)2'KS{uj + . 
Note that G{uj)G{-uj) = \G{uj)\^; then 

( x{lj)x{lj') ) = C{lj)2'kS{uj + lj') with C{uj) = \G{uj)\'^u{uj) . (6.35) 
In a problem solved by 

/oo 
dt' G{t - t') [p{t') + h{t')]+lC, (6.36) 
-oo 

where IC are terms related to the initial conditions, the time-dependent linear response is 

= G{t - t') , (6.37) 



h=0 



(6.38) 



Shit' 

and ^ 

R{lj)= ( dt e"^*R{t) = G{u)) 

J —CO 

Note that the response function is related to the correlation {x{t)p{t') ) by Eq. (6.34): 

2-k5{uj + uj')R{uj)v{<jj) = { x{lj)p{u') ) . (6.39) 

6.4.3 Effective temperature for a generic environment 

Now, one can check under which conditions on the characteristics of the bath [g{t — t') and u^t — t')] 
the fluctuation-dissipation theorem (for the particle) holds and, when it does not hold, which is the 
generic form that the relation between the linear response and correlation might take in this simple 
quadratic model. Eq. (6.33) implies^: 

lmR{Lo) = ImG(w) = lo Reg{Lo) \G{uj)f , (6.40) 

and then using equation (6.35) 



2ImR{uj) 2Reg{ui) ' ^^"'^^'^ 
The fluctuation- dissipation theorem holds only if this ratio is equal to T, see Eq. (6.27). In general, 
one can define a frequency dependent effective temperature Teff{Lo) as 

This function is a property of the bath but it can also be expressed (in this linear problem) in terms 
of measurable quantities, i.e. the correlation and response of the position of the particle. The use of 
the name effective temperature has been justified within a number of models with slow dynamics and 
a separation of time-scales^ [27, 28, 137, 138, 139]. 

*This discussion has to be modified in the fc = limit in which the particle does not have a confining potential and 
diffuses. 

^The definition of effective temperature used here does not have the good thermodynamic properties for all possible 
non-equilibrium systems. Even if it is still not completely established which are the precise requirements needed to 
ensure the thermodynamic nature of this temperature, it seems to be clear that the underlying system must have a 
bounded energy density and that the relaxing dynamics should be slow (a limit of small entropy production, as described 
in [139]). Some cases where these requirements fail have been discussed in [148]. 
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Equilibrated environments: the fluctuation dissipation theorem and Te// = T 

For any environment such that the right-hand-side in Eq. (6.41) equals T the fluctuation-dissipation 
theorem holds. In the time domain, this condition reads 

Tg{t) = e{t)u{t) , u{t) = T[g{t) + g{-t)] = Tgi\t\) . (6.43) 

In particular, this is satisfied by a white noise for which u{t) = 2T^5{t) and g{t) = 2^6{t)6{t) 
(remember that ^(0) = 1/2). This is the noise that appears in Eq. (6.1). The fluctuation-dissipation 

theorem also holds for any colored noise - with a retarded memory kernel g and noise-noise correlation 
V - such that the ratio between Re5(w) and v{io) equals {2T)~^. 

Nonequilibrium environments 

Instead, for any other generic environment, the left-hand-side in Eq. (6.41) yields a non-trivial and, 
in general model-dependent, result for the effective temperature. 

A special case is that of an ensemble of N equilibrated baths with different characteristic times 
and at different temperatures. In this case, the noise p in Eq. (6.28) is the sum of N independent 
noises, 

N 

P = Y.Pi , {pia{t)Pj0{t') ) = 5a06ijTiPi{t - 1') , (6.44) 

i=l 

and the friction kernel is given by 

JV 

9{t-t')=Y,9i{t-t') ■ (6.45) 

i=l 

The temperature has been extracted from the definition of Vi {t) in order to simplify several expres- 
sions as will be clear in the following. As the pi are independent Gaussian variables, p = pi is still 
a Gaussian variable with zero mean and correlation 

(p„(t)P/3(i')) = ^a/3^TiZ.i(i - t') . (6.46) 
i 

Thus, in the Gaussian case the N equilibrated baths are equivalent to a single nonequilibrium bath with 
correlation given by Eq. (6.46) and friction kernel given by Eq. (6.45). In frequency space 

N N 

5(w) = ^5i(w), iy{oj) = J2Tiiyi{u)) , (6.47) 

j=l i=l 

with 

lyiiio) = 2Regi{u) , (6.48) 
as each bath is equilibrated at temperature T,. The effective temperature is then given by 

rr I, ,\ Sill TiViioj) 

TeffH = — • (6.49) 

Note that if the functions are chosen to be peaked around a frequency oji, choosing suitable 

values for and Tj one can approximate a single nonequilibrium bath with A'' baths equilibrated at 
different temperatures. 
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Figure 6.4: (From [146]) Integrated response vs. correlation curves for T — 0.45 < T^. Full line: 
asymptotic (e ~ 0) analytical curve. Dashed lines (from bottom to top) e = 0.333, 0.143, 0.0442. The 
breaking point corresponds to the plateau of C{t). 



Effective temperature in the time domain 

Alternatively one can define the effective temperature in the time domain from the generalization of 
Eq. (6.25): 

1 dx 



TeffiC) dC ' 
or equivalently, recalling that R{t) = 0{t)^, from Eq. (6.26), 



(6.50) 



0(t) dC 

It is important to remark that the effective temperature in the frequency domain, Eq. (6.42), is not 
equal in general to the Fourier transform of the effective temperature Teff{t) = Teff{C{t)) which is 
the ratio between the correlation and response functions in the time domain. 
In the following it will be useful to define the function 

i.e. the Fourier transform of l/Teff{oj). This function should not be confused with the inverse of 
the effective temperature Teff{t). Indeed, if the bath is in equilibrium at temperature T, one has 
Teffit) = T and Te//(a;) = T while T-i(t) = 6{t)/T. 



6.4.4 Mean field glassy systems 



The relation between spontaneous and induced fluctuations found in mean-field glassy models, or, 

equivalently, the relation between R and C in the solutions of Eq. (6.18), is surprisingly simple. 
Indeed, if the "fast" and "slow" time scales are well separated (i.e. for T < Td and e ~ 0, where is 
large, see Fig. 6.2), so that the decomposition (6.22) holds, the plot x(C) is found to be a broken line: 



X{C) = -{1-C) e{C-qd) + 



e{qd - C) 



(6.53) 



see Fig. 6.4 and [137] for a review. This broken line has two slopes, — 1/T for C > qj, {i.e., small 
t — t'), and —1/Teff for C < qa {i.e., large t — t'). Indeed, the first slope gives the relation between 
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Cf and Rf, while the second gives the relation between Cg and Rg'. 



T dt 



^eff 



dt 



The breaking-point q^, as discussed above, has an interpretation as the self-overlap of the states, i.e. 
for t — t' small the system remains in the same state while for t — t' large it jumps to another state"^*^. 
Since Te/ / is found to be larger than T the second term violates the fluctuation-dissipation theorem. 
In order to be consistent with the thermodynamic properties one needs to find a single value of T^f f 
in each time regime as defined by the correlation scales of [141]. 

In presence of a finite drive e > 0, x(C) is a smooth function of C. For e — > and T > T^, the 
system is in equilibrium and x(C) tends to T^^{1 — C), i.e. the fluctuation dissipation relation holds. 
For e and T < Td, — !■ cx3 as discussed above, thus the decomposition (6.22) becomes exact and 
X(C') becomes the broken line (6.53), see Fig. 6.4. Defining a FDT violation factor X = 1/Te//, one 
can draw iso-X lines in the (e, T) plane, see Fig. 6.3, and identify a quasi- equilibrium region defined 
by X 1 (e.g. X > 0.99). In the latter region the fluctuation-dissipation relation (FDR) holds: it 
roughly correspond to the linear response region. 

The same result for x(C), Eq. (6.53), is obtained in the aging dynamics, i.e. for the nonstationary 
solution of Eq.s (6.14): for t,t' ^ oo the separation (6.16) holds and x(C) is given by Eq. (6.53) as 
in the driven case. 

In the case of relaxing glasses the dynamics occurs out of equilibrium because below T4 the equi- 
libration time diverges with the size of the system and falls beyond all accessible time-scales. These 
macroscopic systems then evolve out of equilibrium even if they are in contact with a thermal reser- 
voir, itself in equilibrium at a given temperature T, the white bath in Eq. (6.1), due to the interaction 
between the N{-^ 00) spins. The effective environment appearing in Eq. (6.12) is self-generated by 
the system. 

In the case of sheared dense liquids, glasses, etc. the systems are driven into an out of equilibrium 
stationary regime by the external forces, so one does not expect the FDR to hold. However, for 
T < Td, as the dynamics is very slow and non-stationary at zero forcing, it remains slow also for weak 
forcing, the main effect of a weak forcing being that the system becomes stationary. In this situation 
the FDR is violated also for small drive, e ^ 0, which is a quite unexpected result. 

The suggestive name effective temperature, T^ff, has been used to parametrize the second slope. 
The justification is that for mean-field glassy models — and within all resummation schemes applied 
to realistic ones as well — Te// does indeed behave as a temperature, in the sense that it controls 
heat flows between systems which are in thermal contact [28, 137, 138]. 



6.5 Beyond mean- field 

The results discussed above follow from Eq.s (6.18), which describe exactly the dynamics of mean field 
systems and approximate realistic system as well. For realistic systems they can be derived applying 
suitable resummation and/or approximation schemes. 

^"A similar interpretation is given in term of intra-cage and cage-rearrangement motions in the relaxation of struc- 
tural glasses, intcr-domain and domain wall motion in coarsening systems, etc. More general forms, with a sequence 
of segments with different slopes appear in mean-field glassy models of the Sherrington-Kirkpatrick type, where the 
structure of the metastable states is more complicated. 
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Figure 6.5: (From [146]) Same diagram as in Fig. 6.3, taking into account activated processes. In 
absence of drive the activated processes restore the equality of Tk and T^. However below Tg the 
system cannot be equilibrated on the experimental time scale. The curve iso-Ta corresponding to 
Ta{Tg) = lOOs is drawn as a thick line. Inside the region delimited by this Hnc Ta{e,T) > 100s so 
the system is not able to reach stationarity and ages. The region defined by X > 0.99 is again a 
"near-equiUbrium" region that roughly correspond to the linear response region. 

Indeed, the results described above were obtained in numerical simulations of the slow relaxational 
dynamics of a number of more realistic glassy systems such as Lennard- Jones mixtures [149] , sheared 
Lennard- Jones mixtures [150, 151] and in a number of other driven low-dimensional models [152]. 

However, if one whishes to describe the relaxation of real glasses in finite dimension, more com- 
plicated effects have to be taken into account. The problem is that, as discussed in section 1.4, in 
finite dimensional models metastable states have a finite time and decay by activated processes of 
barrier crossing. These process are of nonperturbative nature so they are missed by any resummation 
scheme leading to equations of the class (6.18). These processes are relevant also at equilibrium as 
they are responsible for the equality of T^ and Tk in finite dimensional systems, while in mean-field 
one finds Td > Tk- Some attempts to describe the equilibrium properties of such processes recently 
appeared in the literature [11, 12, 13, 14, 46, 47], and have been described in section 1.4 . One of the 
main results coming from these studies is that the equilibrium dynamics for T ^ Tg is expected to be 
heterogeneous: this means that the relaxation time is expected to depend on the region inside the 
sample. This is consistent with experimental and numerical results, see e.g. [48] for a review. 

Thus one can expect that heterogeneity is relevant also for the nonequilibrium dynamics yielding a 
local effective temperature which may depend on space inside the sample. This has indeed very recently 
proposed and found numerically in finite dimensional spin-glass models and a theory to describe space 
fluctuations of T,.// has been proposed, see e.g. [153, 154] for a detailed discussion. 

On the other hand, it seems that in presence of a driving force heterogeneity is somehow reduced. 
For example, the strecthing parameter of the correlation functions of density fluctuation (which is a 
measure of the homogeneity of the sample) is found to be an increasing function of the driving force 
in sheared colloidal suspensions, see e.g. the discussion in [155]. 

Another important difference follow from the fact that, in finite dimension, due to activated pro- 
cesses, in absence of drive, the system is able to penetrate below the threshold, and is trapped for large 
times into metastable states from which it can escape only by jumping over some barriers. Then, one 
expects that an infinitesimal drive is not enough to take the system out of these states. This means 



114 



CHAPTER 6. DYNAMICS OF GLASSY SYSTEMS 



that if the drive is small enough the aging dynamics is recovered, as the system can be trapped by 
metastable states as if the drive were not present, see Fig. 6.5 and [146, 151] for a detailed discussion. 

In next chapter, only Langevin equations of the form (6.18) will be considered. The extension of 
the results that will be presented to glassy systems in finite dimension will require additional work. 



Chapter 7 



Extension of the fluctuation 
relation to driven glasses 

7.1 Introduction 

Relatively few generic results for non-equilibrium systems exist. Two such results that apply to 
seemingly very different physical situations have been discussed in the last chapters. One is the 

fluctuation theorem that characterizes the fluctuations of the entropy production over long time- 
intervals in driven steady states, see chapter 4. Another one is the extension of the fluctuation- 
dissipation theorem that relates induced and spontaneous fluctuations in equilibrium to the non- 
equilibrium slow relaxation of glassy systems, see chapter 6. While the former result has been proven 
for reversible hyperbolic dynamical systems [92, 93] and for the driven stochastic dynamic evolution 
of an open system coupled to an external environment [108, 156], the latter has only been obtained in 
a number of solvable mean-field models and numerically in some more realistic glassy systems [140, 
141, 149, 150, 151, 152]. As discussed in section 6.4, the modification of the fluctuation-dissipation 
theorem can be rationalized in terms of the generation of an effective temperature [138, 139]. The 
expected thermodynamic properties of the effective temperature have been demonstrated in a number 
of cases [138] (see however footnote 9 in section 6.4). 

One may naturally wonder whether these two quite generic results may be included in a common, 
more generic statement, that reduces to them in the corresponding limits. The scope of this chapter 
is to discuss this possibility using the very simple working example discussed in section 6.4.2, from 
which one can very easily reach the 'driven limit' and the 'non-equilibrium relaxational' case. This 
project was pioneered by Sellitto [157] who asked the same question some years ago and tried to give 
it an answer using a stochastic lattice gas with reversible kinetic constraints in diffusive contact with 
two particle reservoirs at different chemical potentials. Other developments in similar directions have 
been proposed and analyzed by several authors [158, 159, 160]. They will be discussed in section 7.9. 

The fluctuation theorem and the fluctuation-dissipation theorem are related: indeed, for systems 
which are able to equilibrate in the small entropy production limit {a+ — > 0), the fluctuation theorem 
implies the Green-Kubo relations for transport coefficients, that are a particular instance of the 
fluctuation-dissipation theorem, see [109, 110, 156] and section 4.4.1. That is, close to equilibrium 
the fluctuation relation and the fluctuation-dissipation relation are equivalent. It is then natural 
to wonder what is the fate of the fluctuation theorem if the fluctuation-dissipation is violated even 
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when the driving force is very small, see Fig. 6.4. One can ask if the fluctuation theorem is modified 
and, more precisely, whether the effective temperature enters its modified version. In particular, this 
question will arise if the limit of large sampling time, r in Eqs. (4.21) and (4.23), is taken after the 
limit of large system size. The order of the limits is important because a finite size system will always 
equilibrate with the thermal bath in a large enough time r. As the fluctuation theorem concerns the 
fluctuations of a for r oo, if one wants to observe nonequilibrium effects, the latter limit has to be 
taken after the thermodynamic limit. 

The idea is to study the relaxational and driven dynamics of the simplest system such that the 
effective temperature is not trivially equal to the ambient temperature. For a system coupled to a 
single thermal bath, this happens whenever: 

(i) the thermal bath has temperature T, but the system is not able to equilibrate with the bath. 
This is realized by the glassy cases discussed above, provided the sampling time is smaller than the 
equilibration time; and/or 

(ii) the system is very simple (not glassy) but it is set in contact with a bath that is not in 
equilibrium. One can think of two ways of realizing this fact. One is with a single bath represented 
by a thermal noise and a memory friction kernel that do not verify the fluctuation-dissipation relation 
[28]. This situation is realized if one considers the diffusion of a Brownian particle in a complex 
medium (e.g. a glass, or granular matter) [161, 162, 163]. In this case the medium, which acts as a 
thermal bath with respect to the Brownian particle, is itself out of equilibrium. Another possibility 
is to couple the system to a number of equilibrated thermal baths with different time-scales and at 
different temperatures [139]. 

These two cases are closely related because, as discussed in chapter 6, at least at the mean-field 
level, the problem of glassy dynamics can be mapped onto the problem of a single "effective" degree 
of freedom moving in an out of equilibrium environment. Situations (i) and (ii) are then described 
by the same kind of equation, namely, a Langevin equation for a single degree of freedom coupled to 
a non-equilibrium bath, like Eq.s (6.19) and (6.28). 

In the following the Langevin equation Eq. (6.28) will be considered. Its main characteristic is 
that the thermal bath, represented by the functions g{t — t') and u{t — t'), is not at equilibrium. 
This equation reproduces many features of the original equation (6.19) in the driven case, where the 
functions Y,{t — t') and D{t — t') are stationary. 

7.2 Entropy production rate for a nonequilibrium bath 

The explicit form of o"^ for the equation of motion (6.28), in the case where gap{t) = Sapgit) and 
h{t) = h[r{t)] is an external nonconservative force that does not explicitly depend on time (e.g., in 
d = 2, h = e{—y,x)), can be computed following the procedure outlined in section 4.3.1. Note that 
the functions v^t) and g{t) are such that u{t) = ^{—t) while g{t) is proportional to 6{t), and both 
decay exponentially in time. The probability distribution of the noise p{t) is 

1 




(7.1) 



where v ^{t) is the operator inverse of u{t) 




(7.2) 
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The probability distribution of r{t) is obtained substituting p{t) obtained from Eq. (6.28) in Eq. (7.1). 
Then one has 



V[f{t)] (xexp |-i / dtdt' \mra{t) + [ dt"g{t - t")fa{t") + |^ - K[ 



mr. 



J — i 



dt"'g{t'-t"')r^{t"') 



5V{r) 



ha[r{t' 



(7.3) 



With some manipulations it is easy to see that 

V[r{-t)] ocexp |-i r dtdt' Lr„(i) - H dt"g{t" - t)f^{t") + - KW)] 



xv-\t-t') 



mfa{t') 



dt"'g{t"'-t')f„{t"') + 



5V{r) 



(7.4) 



5r^{t') 

To compute (Tr one should consider the probability of a segment of trajectory [— r/2, r/2] and then 
send r to oo, neglecting all boundary terms. As the functions g{t) and i>{t) have short range, the 
trajectories f{t) decorrelate exponentially fast in time and up to boundary contributions one can 
simply truncate the integrals in 'P[f{t)] in t,t' £ [— t/2,t/2] to obtain the probability of a segment 
of trajectory for large r. Equivalently one can consider the integrals in (— oo, oo) and neglect all the 
boundary terms: then one obtains the entropy production CToo integrated over the interval t G (— oo, oo) 
and one can truncate the integral in [— t/2, r/2] at the end of the computation. 

A lot of terms in cjoo = — ^ogP[f{—t)]+\ogV[f{t)] trivially cancel. Before discussing the non-trivial 
terms, define f{t) = g{t) + g{—t) and recall that, from Eq. (6.52) 



T-\t-t") 



f 

J — ( 



duj 2'R.eg{(jj) 



-iuj{t—t") 



dt'v-\t-t')f{t' -t") . 



(7.5) 



27r v(uj) 

Note that both f{t) and T~^{t) are even function of t, and if the bath is in equilibrium at temperature 

T, r-i(t-t') = 5{t-t')/T. 

The terms that do not cancel trivially are the following: 

• a "kinetic" term of the form 

/oo r />oo />oo 

dtdt' mra{t)u-'^{t-t') / dt" g{t" - t')ra{t") + mra{t)iy~'^{t - t') / dt" g{t' - t")fa{t") 
-OO L ■/—CO 'J —OO 

/OO fOC pOO 

dtdt' mra{t)iy~^{t - t') / dt"f{t' - t")fc{t") = / dtdt' mra{t)T-^{t - t')f^{t') . 
-OO J — OO J — OO 

(7.6) 

If the bath is in equilibrium, this term trivially vanishes as it is the integral of the total derivative 
of the kinetic energy. It vanishes also for a nonequilibrium bath: indeed, integrating by parts 
first in t and then in t', one has, recalling that T^^(t) is even and short ranged and up to 
boundary terms: 



/oo f°° d 

dtdt' ra{t)T-\t - t')fa{t') = - dtdt' ra{t)—T-\t - t')f„{t') = 
-oo J — oo "'t 

/oo J l-OO 

dtdt' roc{t)-pT-^{t - t')foc{t') = - dtdt' fa{t)T-'^{t - t')f^{t') = . 
- C50 J — oo 



(7.7) 



a "friction" term of the form 
1 
2 



1 /-oo 

- / dtdt'dt"dt"' [ra{t")g{t" - t)u-\t - t')g{t"' - t!)foc{t"')- 
f^{t")g{t - t")u-\t - t')g{t' - t"')fo,{t"')\ . 



(7.8) 
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This term vanishes because the function 

K{t" - t'") = J dtdt' g{t" - t)v-^{t - t')g{t"' - t') 

is even in its argument as one can easily check. 
• a "potential" term of the form 

<7^ = - 1°° dtdt'dt" fit - t")rc.{t")u-\t - 



(7.9) 



/OC' 
dtdt'T-^{t-t')fa{t) 
-OO 



6V{r) 



(7.10) 



This term is related to the work of the conservative forces. If the bath is in equilibrium, it 
vanishes being the total derivative of the potential energy. It vanishes also for an harmonic 
potential V{f) = \kr'^ because = kra{t) and one can use the same trick used in Eq. (7.7). 



• a "dissipative" term which is 



/OO (*C 
dtdt'T-\t-t')fo.{t)K[r{t')] = / 
-OO — c 



2^ Te//(a;) 



(7.11) 



This term is related to the work of the dissipative forces. If the bath is in equilibrium at 

temperature T, this is exactly the work of the dissipative forces divided by the temperature of 
the bath. Otherwise, the work done at frequency w is weighted by the effective temperature at 
the same frequency. 

The expression of the total entropy production over the interval (— oo, oo) is then 
<7^ = + atlf = p dtdt' T-\t - t')r^{t) + KW)] 

/OO 
dtdt'T-^{t-t')f^{t)F^{t') , 
-CX3 



(7.12) 



where Fa{t) = ha[r{t)] — is the total deterministic force acting on the particle at time t. The 

latter expression can be rewritten as 



/oo 
dt / dt'T-\t-t')[fc,{t)F^{t') + r^{t')F^{t)\ 
-OO •/ — oc 



(7.13) 



and this leads to identify the entropy production per unit time at with 



V , eff 



dt' T-\t - t') [f„(i)F„(t') + ra(t')^a W] 
aY = - f dt'T-\t-t') 

J — OO 



(7.14) 



/* dt:T-^{t-t:){fo,{t)hoXf{t!)\ + fo,(t:)ho\7{t% . 

J — CO 



If the bath is at cqiiilibrium this expression reduces to the work done by the nonconscrvative forces 
divided by the temperature of the bath, as expected. Also if the bath is not at equilibrium, but the 
potential is harmonic, only the contribution Uj^'^ of the nonconscrvative force has to be taken into 
account. The reason why the work of the conservative forces produces entropy if the bath is out of 
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equilibrium and the interaction is nonlinear is that the nonlinear interaction couples modes of different 
frequency which are at different temperature, thus producing an energy flow between these modes; 
this energy flow is related to the entropy production. 

It is also important to remark that boundary terms, that have been neglected in the calculation 
above, can have important effects on the large fluctuations of cr^ even for r — > oo [120], as discussed 
in section 4.4.3. 



7.3 Large deviation function for an harmonic potential 

The large deviation function in the harmonic case, V{r) = ^kr^, will now be computed explicitly. 
In this case aY is a total derivative, and only the term a^-^^ related to the nonconservative forces 
is relevant. This term is proportional to the driving force so it vanishes identically at equilibrium 
as requested by the empirical prescription of section 4.4.3, so "spurious" contributions coming from 
boundary terms should be absent. It will be shown that the characteristic function^ z{X) of a"^^-^ 
exists, is a convex function of A and verifles the fluctuation relation ^;(A) = z{l — A). 



7.3.1 Equilibrium bath 

As a flrst illustrative example the case of an equilibrium white bath will be considered. The model is 
a two dimensional harmonic oscillator with potential energy V{x,y) = | {x^ + y^) coupled to a simple 
white bath in equilibrimn at temperature T, and driven out of equilibrium by the nonconservative 
force h = e{—y, x). The equations of motion are 

mxt + ^xt = -kxt -eyt + it , , , 

(7-15) 

myt + ^yt = -kyt + ext + m , 

where and r]t are independent Gaussian white noises with variance {^t^o) = {vtVo) = 2'yT5{t). 
The memory friction kernels gai3{t — s) are simply Sce0g{t — s) = 2Sa0'yS{t — s)9{t — s) in this case, 
with 7 the friction coefficient. 

Defining the complex variable at = {xt + iyt)/V^ and the noise pt = (^t + iilt)/^/^ the equations 
of motion can be written as 

mat + lilt = -nat + pi , (7-16) 

where k = k — ie, {ptpo) = {ptpo) = and {ptpo) = 2'yT5{t). The complex noise pt has a Gaussian 
PDF: 



Vlpt] oc exp 



(7.17) 



The energy of the oscillator is H = maa + kaa, and its time derivative is given by 

= 2mRedtat + 2A;Re ajat = 2elmdtat — 270*04 + 2Re atpt = Wt — Wt , (7-18) 

where Wt = 2elmatdt = e{xtyt — Vtit) is the power injected by the driving force and Wt = 2'yatat — 
2'Redtpt is the power extracted by the thermostat^. 



^Froiu now on the suffix oo in Zoo will be omitted because in next sections only the asymptotic large deviations 
functions will be considered. 

^Henceforth the sign of the powers are chosen such that they have positive average. 
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The entropy production rate (7.14) reduces, as expected, to the injected power divided by the 
temperature, at — PWt, where (3 = 1/T. One could also consider the entropy production of the bath, 
at = PWt; it will be discussed in Appendix 7.12. 

The average value of at = PWt is in this case given by a+ = 2e^/ (7^:). To compute the probability 
distribution function (pdf) of at, it is useful to rewrite it in terms of the complex variable at: 



t/2 

dt at = 2e/3 Im / dt dtdt ■ 

J-rl 



r/2 



r/2 



(7.19) 



As already discussed, it is easier to compute the characteristic function z{\), Eq. (4.24), in terms of 
which the fluctuation relation reads z{\) = z(l — A). To leading order in r one can neglect all the 
boundary terms in the integrals. After integrating by parts. 



.r/2 

CTi- = 2ef3i / dt atat , 

J-t/2 

and recalling that the pdf of the noise is given by Eq. (7.17) one obtains: 



(exp[-Ac7x]) = A/""^ / dV[pt] exp 



2ieX 



r/2 



dt atat 



r/2 



(7.20) 



(7.21) 



where the normalization factor M = j dV[pt\ is simply given by the numerator calculated at A = 0. 

At the leading order in r the function z{\) should not depend on the boundary conditions in 
Eq. (7.21). Thus, one can impose periodic boundary conditions, a{T/2) = a(— r/2) and d{T/2) = 
d(— t/2), and expand at in a Fourier series, 



at 



27 



J2 a™ 



-iUJnt 



(7.22) 



where Au = 27r/r and a;„ = nAu). For r — > 00 

du) 



at 



J —I 



2tt 



6 , 



r 

J — ( 



dt e"^*at 



(7.23) 



and the equations of motion become 



— w^m + K — iw7 D{ijj) 



(7.24) 



Note that in the limit e = the Green function G(e, w) = 1/D{u)) reduces to the one used in sec- 
tion 6.4.2 to compute the violation of the fluctuation-dissipation theorem induced by a nonequilibrium 
bath. The distribution of the noise is given by 



V[pu;] = exp 



1 f°° div 



exp 



1 Ao; ^ 



Substituting Eqs. (7.22) and (7.25) into Eq. (7.21) one has 



(exp[— Act^]) = /V ^ J dp„exp 

47eAw; 



Aw 
'27 



^[2^T T\DM^) 



n 



1 - 



\D{uJnW 



n— — 00 
-1 



(7.25) 



(7.26) 
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and using Eq. (4.24) 
^(A) = 



lim — log 

T— s-OO T — ^ 



1 



dto , 



1 



To show that z{X) verifies z{X) = z{l — A) and hence the fluctuation theorem, note that 

|£>(w)|2 - 47eAw 



2(A) -z(l- A) = 



log 



|£>(a;)|2 - 47e(l - A)a; 



(7.27) 



(7.28) 



and, as |Z)(a;)|^ — 4e7a; = \D{—u))\^, the integrand is an odd function of ui and the integral vanishes 

by symmetry. In Appendix 7.10 it is shown that the same result is obtained if one uses Dirichlct 
boundary conditions (at least for m = 0, whore the computation is feasible); this result supports 
the approximations made when neglecting all the boundary terms in the exponential. Moreover, in 
the case m = the large deviation function ({p) can be explicitly calculated; defining to = j/k and 
(To = cr+ro/2 = e^/fc^, one obtains 



Cip) 



1 



V(l + (7o)(l+p2ao) 



Thus, for T — > 00 the PDF of p has the form 



TTrip) OC exp 



To 



■./(p,o-o) 



(7.29) 



(7.30) 



Note that tq is the decay time of the correlation fimction of at [i.e. (atdo) oc cxp(— i/ro)] and ctq is 
the average entropy production over a time to/2. Thus, tq is the natural time unit of the problem 
(as expected); remarkably, the function / depends only on uo and not on the details of the model. It 
would be interesting to see whether the same scaling holds for more realistic models. 

In summary, for all driving forces, i.e. all values of e, the fluctuation theorem holds for the 
entropy production rate (7.14). For a white equilibrium bath this result is a particolar case of the 
general theorem derived in [156]. The temperature entering the fluctuation theorem is the one of the 
equilibrated environment with which the system is in contact, although it is not in equilibrium with 
it, when the force is applied. 

One can easily check that the fluctuation-dissipation relation holds in the absence of the drive (sec 
section 6.4.2) but it is strongly violated when the system is taken out of equilibrium by the external 
force. 



7.3.2 Non-equilibrium bath 

The calculation will be now generalized to the case of a generic nonequilibrium bath; the equation of 
motion becomes: _ 

/oo 
dt' g{t - t')dt' = -nat + pt , (7-31) 
-oo 

where as before k = k — ie and {ptPo) = i^{t)- The functions u{t) and g{t) are now arbitrary (apart 
from the condition g{t) = for t < 0), hence they do not satisfy, in general, Eq. (6.43). As discussed in 
the introduction of this chapter, Eq. (7.31) provides a model for the dynamics of a confined Brownian 
particle in an out of equilibrium medium [161, 162, 163]. 
The dissipated power is given by 



dH 
'dt 



/OO 
dt' g{t - t')dtat' + 2RedtPt = Wt-Wt , (7.32) 
-CSO 
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where as in the previous case Wt ~ 2elnid(af is the power injected by the external force and Wt 
2Re dt' g{t — t')atat' — 2ReatPt is the power extracted by the bath. 
For this harmonic model is a boundary term and Eq. (7.14) gives 



Teff{u>n) 



/.t/2 

2ei / dt 

J-t/2 J-t/2 



dt' T-^{t-t')attLv 



(7.33) 



Note that the last equality holds neglecting boundary terms. 

It is interesting to consider also an "alternative" definition of entropy production rate, which 
has been often used in the literature [84, 104, 105, 106]. It is obtained assuming that the entropy 

production rate is proportional to the power injected by the external drive, af = Q~^Wt^ via a 
parameter O which has the dimension of a temperature. Then, the total entropy production over a 
time r for Eq. (7.31) is given by (neglecting boundary terms) 



2ei 



"/2 . Aw 
dt atttt = — 2e- 

r/2 



°° I |2 
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(7.34) 



Usually, in experiments, is a free parameter which is adjusted in order for the PDF of cr® to verify 
the fluctuation relation [104, 105, 106]. It is interesting to compute the large deviations function of 
af to check if it verifies the fluctuation relation. 

The functions zq{X) and Zeff{X) corresponding to the two entropy production rates deflned above 
will now be computed. The computation is straightforward following the strategy of section 7.3.1. In 
Fourier space, Eq. (7.31) reads 

Puj PiJ 



+ K — iujg{uj) D{ui) 



The probability distribution of is 

V[pu,] = exp 

thus, as in Eqs. (7.25) and (7.26), 

(exp[-Aaf ]) = TV"^ y dpnexp 

oo 

= n 

and 



dw\pu^ 
27r 
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^e(A) = r 

J — c 



dco 
2^ 



log 



2eXwi'{u)) 
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(7.38) 



The function Zeff{X) is obtained by substituting — > Teff{ui) with the latter defined in (6.42): 

4:€Xu)Reg{(jj 



e//(A) 



dbJ , 



1 



\D{oj) 



(7.39) 



It is easy to prove that \D{ui)\'^—4:€U)Reg{Lv) = \D{—ui)\'^. Thus, using the same trick used in Eq. (7.28), 
one can prove that Zeff{X) = Ze//(1 — A). On the contrary, in general, it is not possible to find a value 
of Q such that 2;e(A) satisfies the fiuctuation theorem. It will be shown in the following that this is 
possible only in some particular situations: essentially, when the dynamics of the particle happens on 
a single time scale, that corresponds to the experiments cited above. 
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In conclusion, the fluctuation theorem is satisfied when the entropy production rate is defined 
using the power injected by the external drive and the temperature of the environment - that is not 
defined in the case of a nonequilibrium bath - is replaced by the ratio in (6.42). 

Note that, as discussed in section 6.4.3, a single nonequilibrium bath can be equivalently repre- 
sented by many equilibrated baths at different temperatures, eventually acting on different time scales. 
In Appendix 7.11 it will be shown that also in this case the PDF of the entropy production rate a'^^^ 
defined in Eq. (7.33) verifies the fluctuation theorem, while the PDF of cr® does not. 

Moreover, in the latter case one can also consider the entropy production of the baths, deflned 
as the power extracted by each bath divided by the corresponding temperature. This quantity is of 
interest if one can clearly identify the different thermal baths with which the system is in contact: 
this is not the case in glassy systems, where the effective temperature is self-generated by the system. 
Nevertheless, the study of systems of particles coupled to many baths at different temperature is 
of interest in the study of heat conduction. In Appendix 7.12 it will be proven that the entropy 
production rate of the baths verifies the fluctuation theorem, at least for \p\ < 1, see the discussion in 
section 4.4.3 and [120]. 



7.4 Numerical results 

Some numerical simulations of Eq. (7.31) for a particular choice of the nonequilibrium bath and in 
presence of a linear and nonlinear interaction have been performed. In the linear case, the numerical 
results confirm the analytical results of the previous section. This finding confirms that the boundary 
terms neglected in the analytical computation are indeed irrelevant. In the nonlinear case, it is found 
that the fluctuation relations holds for o^^^ , as in the linear case. 

The simplest non trivial case has been considered, where a massless Brownian particle is coupled 
to two equilibrated baths: a white (or fast) bath at temperature Tj and a colored (or slow) bath 
with exponential correlation at temperature Tg. This model has been studied in detail in [139] and 
is relevant for the description of glassy dynamics when the time scales of the two baths are well 
separated, as will be discussed in section 7.5. In Appendix 7.11 the general case of an harmonic 
oscillator coupled to N colored baths is studied. The equations of motion are given by Eq. (7.31) 
where g{t) = gj{t) + ,g,,(t), ,g/(t) = 7f^it) and g^it) = e{t)^e~^ , or equivalently .g/(w) = 7/, 
gsi^j-') = 7s/(l ^ii-^Ts). The harmonic potential is replaced by a generic rotationally invariant potential 
V{x, y) =V (j—^^ = V(|ap). The noise is the sum of a fast and a slow component. Then Eq. (7.31) 
becomes: ^ 

7/at + — / dt' e-'-^at' = -atV{\at\^) + ieat + p{ + pt , (7-40) 

where {p(p(,) = 2jfTfd{t - t'), {plpl,) = ^e"!*-*'!/^' and V'(x) is the derivative of V{x) w.r.t. x. 
It is convenient to rewrite this equation in a Markovian form as follows: 

*" - + ^? ' (7.41) 
-if at = -atV'{\at\'^) + ieat +pi+bt-^ , 

where the auxiliary variable bt has been introduced and Vt is a white noise with correlation {vtVt') = 
2^sTs6{t—f). The power injected by the external force is, as usual, Wt = 2elm citdi, while the power ex- 
tracted by the two baths can be written as Wj = 2Re at (^7/at — p/ ^ and = 2Rc dt (^-^ai — btj 
In the nonlinear case the potential V(|ap) = f as been chosen, and the results are compared 
with the ones obtained for the harmonic case, V(|a|^) = k\a\'^. The simulation has been performed 
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for e = 0.5, Tf = 0.6, 7/ = 1, Tg = 2, 7^ = 1 and Tg = 1, setting k = 1 in tlie linear case and 
g = I'm the nonlinear one. The system (7.41) is numerically solved via a standard discretization of 
the equations with time step 5t = 0.01; the noises are extracted using the routine gasdev of the C 
numerical recipes. 

It is numerically found that cr^ and a^-^-^ are uncorrelatcd (within the precision of the numerical 
data), so their PDF can be studied separately. Unfortunately, the PDF of aY is too noisy to allow for 
a verification of the fluctuation relation in the nonlinear case. This is probably due to the fact that 
in the linear case reduces to a boundary term^; in the nonlinear case it is not a boundary term, 
but still it might contain "spurious" boundary terms which should be eliminated, see the discussion 
in section 4.4.3. Indeed, for the accessible values of r. it is observed that the variance of aY is much 
larger than its average (while the FR would predict a variance of the order of cr^ ). This large variance 
can be a finite-r effect due to the presence of a boundary term whose fluctuations contribute to the 
fluctuations of but not to the average. If this is the case, the FR should hold at least for \p\ < 1 and 
very large r: but the values of r can be so large that the FR is unobservable in practice, sec [100, 118]. 
For this reason, in the following the data for will not be discussed. The validity of the FR for 

(possibly minus a boundary term) in the nonlinear case remains an open question that should be 
addressed by future work. 

7.4.1 "Effective" entropy production rate 

The effective entropy production rate a^^^ , from Eq. (7.14), is given by: 

a^ff = I dt' T-\t - t') 2elm [htCLt^ + hfCLt] , (7.42) 

J — CO 

with T~^{t) the Fourier transform of l/Te//(a;). From Eq. (6.49) the latter is given by 

1 _ 7/(l+wV2)+7, 



Te//(a;) T/7/(l+a;2r|)+T,7« 

Thus 



(7.43) 



T-\t) = Uif)^^(l-^Y^ , with n = L. Im±l£ll. (7.44) 



and T ^{t) decays exponentially for large t. Note that, if the bath is at equilibrium, Tg = Tf = T, 
so one has T~^{t) = S{t)/T and a^^-^ = 2e\m htCbt/T = Wt/T as expected (recall that by convention 

r_^dt'5{t-t')=i). 

The data for cr^'^'^ arc shown in Fig. 7.1. The large deviation function Ce//(p) is reported in 
panel a) for the harmonic and in panel c) for the quartic potential. The average cr'^^'' is equal to 
0.332 in the harmonic case and to 0.276 in the quartic case. The function Ceff{p) converges fast to 
its asymptotic limit r — > 00 (note that even the data for r 10 are in quite good agreement with 
the analytic prediction for the harmonic case). The fluctuation theorem predicts f{p) = [Ce//(p) — 
Ceff{^p)]/'^+'^ = P- The fimction f{p) is reported in panel b) for the harmonic and in panel d) for 
the quartic potential. In the harmonic case the numerical data are compatible with the validity of 
the fluctuation theorem, as predicted analytically. Remarkably, the same happens in the quartic case 
where the analytical prediction is no more available. 

These results support the conjecture that, if aY '^iid '^t^^ ^■re uncorrelated, the PDF of a^^^ verifies 

the fluctuation theorem independently of the form of the potential V{x,y). 

■^This is also observed in the simulation, because the average of vanishes and the variance of does not grow 
with r. 



7.4. NUMERICAL RESULTS 



125 




Figure 7.1: PDF of CTj : a) The large deviation function for the harmonic potential at r = 10, 20, 30; 
the full line is the analytical result, b) The function f{p) = [Qf / (p) — Cef f {~P)]/'^'+'^ fo^' the harmonic 
potential: the fluctuation theorem predicts a straight line with slope 1, represented by a full line, c) 
The large deviation function for the quartic potential at r = 10, 20, 30. d) The function f{p) for the 
quartic potential: also in this case the fluctuation theorem is well verifled. 

7.4.2 "Classical" entropy production rate 

It is interesting to investigate numerically also the fluctuations of the entropy production rate cr®, 
defined in section 7.3.2 as 

= ^ = • (7-45) 

Rather arbitrarily Q = Tf was set in the definition of erf. This reflects what is usually done in 
numerical simulations, where the dissipated power is divided by the "kinetic" temperature, i.e. the 
temperature of the fast degrees of freedom. Note that the choice Q = Tf does not affect the function 
Ceip) since the variable p is normafized, i.e. (^{p) = ({p) does not depend on 0, see Eq. (4.21), but 
it changes the average cr^ that is proportional to 8^^. 

The data for af are reported in Fig. 7.2. The harmonic case is shown in panels a) and b) while the 
anharmonic case is presented in panels c) and d). The value a^^ = 0.455 is obtained for the harmonic 
potential and a'^^ = 0.366 for the quartic one. The large deviation function of erf agrees very well 
with the analytical prediction in the harmonic case but it does not verify the fiuctuation theorem for 
Q — Tf, as one can clearly see from the right panels in Fig. 7.2. 

Remarkably, in both the harmonic and anharmonic cases the function f{p) = [C{p) — C{~p)]/'^'+^ 
is approximately linear in p with a slope X such that 1 > X > Tf /T^, i.e. ({p) — C(~P) ^ ^ P'^'+^ ■ If 
f{p) ^ Xp, one can tune the value of Q in order to obtain the fiuctuation relation C,{p) — C(~p) — P<^+, 
simply choosing Q = Qeff = Tf/X, thus defining a single "effective temperature" Qeff G [Tf,Ts]. 
From the data reported in Fig. 7.2 one gets a slope X ~ 0.66, that gives Qeff — Tf/X ~ 0.9. 
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Figure 7.2: PDF of af: a) The large deviation function for the harmonic potential at r = 10,20,30; 
the full line is the analytical result, b) The function J{p) = [C,{p) — C,{—p)\/ a'jf for the harmonic 
potential. The full line is the analytical prediction, the dashed line is the prediction of the fluctuation 
relation, the dot-dashed line has slope Tj /Tg. c) The large deviation function for the quartic potential 
at r = 10, 20, 30. d) The function f{p) for the quartic potential; the dashed line is the fluctuation 
theorem, the dot-dashed line has slope Ty/Tg. 



This behavior reflects the one found in some recent experiments [104, 105, 106, 164] in situations 
where the dynamics of the system happens essentially on a single time scale. This is the case also in 
the numerical simulation presented here: in Fig. 7.3 (left panel) the autocorrelation function C{t) = 
Re(atao) of at (computed in Appendix 7.14) is reported for the harmonic potential. The present 
simulation refers to the curve with = 1, which clearly decays on a single time scale. 

In Fig. 7.3 (right panel) the parametric plot x(C') (see section 6.4.2) for the same set of parameters, 
but e = 0, is shown. The integrated response is given by x(i) = /□ dt' R{t') and R{t) is computed in 
Appendix 7.14. For — 1, the function x(C) has slope close to —l/Tf at short times (corresponding 
to X ^ 0). For longer times, the slope moves continuously toward —l/Tgff, with T^/f ^ 1.37. This 
value of Tgff is of the order of ^^"^^"1"^°"^° = 1.3, which means that on time scales of the order of 
the (unique) relaxation time the two baths behave like a single bath equilibrated at intermediate 
temperature. This would be exact if the time scales of the two baths were exactly equal. 

It is worth to note that in this situation one has Tgff ^ Qeff, that is, the effective temperature 
that one would extract from the approximate fluctuation relation of Fig. 7.2 is not coincident with the 
effective temperature obtained from the x(C') plot of Fig. 7.3. In particular, Tf < Qeff < Teff. this 
relation is consistent with the results obtained from the numerical simulation of a sheared Lennard- 
Jones-like mixture that will be presented below [164], even if the coincidence might be accidental. 
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Figure 7.3: (Left) Normalized autocorrelation functions of at for the harmonic oscillator with e — 0.5, 
k ^ I, Tf ^ 0.6, Ts = 2, 7/ = 1, 7s = kTs and = 1,50,250. (Right) Parametric plot of the 
integrated response x(t) as a function of the correlation function C{t) for the same parameters but 
e = 0. The dot-dashed line has slope —1/1.37, the dashed lines have slope — l/T, and —1/Tf. 



7.4.3 Summary of the numerical results 

The numerical simulation of the non-linear problem confirms that the fluctuation theorem is satisfied 
exactly when the entropy production rate a^ff is defined using the power injected by the external 
drive and the temperature of the environment - that is not defined in the case of a nonequilibrium 
bath - is replaced by the ratio in (6.42). 

In situations in which the dynamics of the system happens on a single time scale, a constant effective 
temperature &ef f can be introduced to obtain an approximate fluctuation relation defining the entropy 
production rate as Wt/Qeff- However, &eff is not necessarily related to the effective temperature 
Teff that enters the modified fluctuation-dissipation relation, and in the systems considered so far 
[164] it seems that 6e// < ^e//- 

As will be shown in the following, when the dynamics happens on different, well separated, time 
scales, it is impossible to find a single value Oeff such that af = Wt/Q verifies the fluctuation relation. 



7.5 Separation of time scales and driven glassy systems 

As discussed in chapter 6, in the study of mean-field models for glassy dynamics [28, 139] and when 
using resummation techniques within a perturbative approach to microscopic glassy models with 
no disorder, effective equations of motion of the form of Eq. (6.19) are obtained. In the case of 
a driven mean field system [145, 146], the external force is also present in Eq. (6.19) and after a 
transient the system becomes stationary for any temperature, i.e. fi(t) = fi, S(t, i') = E(t — t'), and 
D{t,t') = D{t — t'). The functions D and S depend on the strength e of the driving force, e.g. as 
in Eq. (6.21), and do not satisfy the detailed balance condition. However, it is possible to rewrite 
Eq.s (6.21) as 

Z,.|c-.+4c'-..D, + ^^^^^ 
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so that S and Dq verify the detailed balance condition. From the expressions (7.46), one can rewrite 
Eq. (6.19), in the following way: 

/oo 
dt' T,{t - t')a{t') + p{t) + eh{t) , 
-OO 

{p{t)p{t')) = 2T6{t - t') + Do{t - t') , 
{h{t)h{t'))=D^{t-t') , 

where p{t) and h{t) are two uncorrelated Gaussian variables. Note that S and Do still depend 
implicitly on e as one has to solve the self-consistency equations for C and R and substitute the 
result in S and Dq. However, suppose that the equations have been solved and the solution for 

and i?e has been plugged in S and Dq. If the term proportional to h{t) in Eq. (7.47) is removed, 
as S = RDq{C), Eq. (7.47) derives from a Langevin equation where only conservative forces are 
present [144]. This means that the term corresponding to the external driving is represented only by 
h{t), and the dissipated power is given by W{t) = eh{t)&{t). Indeed (see Appendix 7.13), 

/■oo jL poo 

{W)=e^ dtR{t)Di{t)=e'^^ dtR{t)C''-\t) , (7.48) 
Jo 2 Jo 

consistently with the result of [146] where the average of the injected power was explicitly computed 
for the driven spherical p-spin. Thus one obtains an equation that is very similar to Eqs. (7.31) 
and (7.40), where S(Ce,i?e) and Z)o(Ce) represent the nonequilibrium bath, and eh{t) is the external 
driving force: and one can prove that the effective entropy production rate 

(T^ff{t) =e f dt' T-\t - t') [h{t)a{t') + h{t')&{t)\ , (7.49) 

J — OO 

where Teff{uj) — 2Re [i+s([!;)/(ia;)] ' '^^rifies the fluctuation relation, see Appendix 7.13. 

As discussed in [146], for small e and T > T4, R^ and verify the fluctuation-dissipation theorem, 
so the same happens for Dq and E, i.e. Teff{u>) = T. The transport coefficient related to the driving 
force e approaches a constant value for e — > (the linear response holds close to equilibrium) and 
the systems behaves like a "Newtonian fluid" . In this situation, the system behaves as if coupled 
to a single equilibrium bath (and the fluctuation theorem holds for the entropy production rate 
Wt/T=€h{t)&{t)/T). 

Below Td, the fluctuation-dissipation relation is violated also in the limit e ^ where it is a simple 
broken line, sec Fig. 6.4, with temperature T at short time and Tg// at long times. The transport 
coefficient diverges in this limit: the system is strongly nonlinear and behaves as if coupled to two baths 
acting on different time scales and equilibrated at different temperatures, and the correct definition of 
entropy production rate is Eq. (7.49). In the region e and T < Td, when the two relaxation scales 
are well separated, it is possible to separate the "fast" and "slow" parts of the equation of motion 
{adiabatic approximation). This allows to write all the relations in a particularly simple way. 

7.5.1 The adiabatic approximation 

When a simple system is coupled to a complex bath with two (or more) time scales these are induced 
into the dynamics of the system. When the time-scales are well separated, an adiabatic treatment 
is possible in which one separates the dynamic variables in terms that evolve in different time-scales 
(dictated by the baths) and are otherwise approximately constant. 



(7.47) 
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Figure 7.4: Power spectrum of the entropy production rate (full line) as a function of the frequency 
for the harmonic oscillator with e = 0.5, = 1, T/ = 0.6, Ts = 2, 7/ = 1, 7^ = fcr^ and Ts = 250. The 
dot-dashed line is the "slow" contribution of if*, the dashed line is the "fast" contribution of wt- 

In this section an adiabatic approach [139] is used to treat simple problems coupled to baths that 
evolve on different scales. The motivation for studying this type of problems is that the separation of 
time-scales is self-generated in glassy dynamics, as described above. 

The PDF of af and a^^^ will be studied. The latter satisfies the fluctuation theorem exactly, 
and the adiabatic approximation does not spoil this feature. The former, instead, does not satisfy 
the fluctuation theorem in general. The origin of this difference will be evident in the adiabatic 
approximation. 

Consider again the Langevin equation (7.40) with V(|ap) — k\a\'^ . In this case, the correlation 
functions can be calculated explicitly, see Appendix 7.14. In Fig. 7.3 the autocorrelation function, 
C{t) — {atOLo), is reported for e = 0.5, k = I, Tf = 0.6, = 2, 7/ = 1, 7s = /cTj and different values 
of Tg. Clearly, for kTs = 7s 3> 7/ two very different time scales -related to the time scales of the two 
baths- are present. From the plot of Fig. 7.3 one sees that in the case kTg = 250 ^ 7/ the function 
x(C) is a broken line with slope —1/Tf at large C (short times) and —l/Tg for small C (large times). 

In this situation, the variable at can be written as the sum of two quasi-independent contributions. 
Using the construction introduced in [139] one can rewrite the equation of motion (7.40) as 



The variable ht is "slow" ; considering it as a constant in the first equation, the variable at will 
fluctuate around the equilibrium position ah = h/{k + 'js/Ts — ie) = H. The latter will -slowly- evolve 
according to the second equation in (7.50), in which one can approximate at' Ht' . Defining the 
-fast- displacement of at w.r.t. Ht, Wt = at — Ht, one obtains the following equations for {wt, Ht): 



In this approximation, at — Ht + wt is the sum of two contributions: wt is a "fast" variable which 
evolves according to a Langevin equation with the fast bath only and a renormalized harmonic constant 




(7.50) 




(7.51) 
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k + Js/ts, while Hf is a "slow" variable which evolves according to a Langevin equation where the 
slow bath only appears. In both equations the driving force e is present, thus one expects both Ht 
and wt to contribute to the dissipation. Note that wt and Ht are completely uncorrelated in this 
approximation. 



7.5.2 aY in the adiabatic approximation 

In the adiabatic approximation, one can argue that the term aY in equation (7.14) becomes a boundary 
term. Indeed, the function T~^(<), in the adiabatic approximation, becomes 



T-\t) = ^S{t)+T-\t) 



(7.52) 



where the function ^{t) is "slow", see e.g. equation (7.44). Inserting this expression in aY , the first 
term gives a total derivative. The second term gives 



J — ( 



dt'T-\t-t') 



■ . , , SV(r) . , 6V(r) 



(7.53) 



Due to the convolution with the "slow" function Tf^{t), the fast components of r are irrelevant in the 
integral, while for the slow ones it is reasonable to replace ra(t) with fa{t') on the scale Tg over which 
T~^{t) decays. Thus one obtains again a total derivative times the integral of T~^{t) which is a finite 
constant. Obviously this is not a rigorous proof and should be checked numerically in concrete cases. 

7.5.3 PDF of af^ 

The entropy production rate defined in Eqs. (7.33) and (7.42) can be rewritten in terms of Ht and Wt- 
Recalling that T~^{t) is defined by Eq. (7.44) one obtains (the details of the calculation are reported 
in Appendix 7.15) 



e// 



2elm 



WtWt 



HtHt 

T, 



(7.54) 



neglecting terms that vanish when a^^'^ is integrated over time intervals of the order of r^. This is 
exactly the entropy production expected for two independent systems. 

To check that this approximation works well, one can introduce a "power spectrum" a{co)duj 
as the contribution coming from frequencies [oj,u + dco] to the average entropy production rate, 
a^^f = J^(L)a{co). From Eq. (7.39) one has 



,eff 



dz, 



eff 



2n 



A=0 



duj 2eLUh'{Lo) 
2^ \D{uj)\^ 



+ 



eujv{uj) 



\D{- 



(7.55) 



Substituting the expressions of y{oj) and of D{oj) appropriate for Eq. (7.40) one gets the power 
spectrum a{u)) as a function of lo which is reported in Fig. 7.4 as a full line. The contributions of 
Wt and Ht, (Tw{^) and (T^f(cij), are obtained inserting in Eq. (7.55) the expression of viuo) and D{uj) 
obtained from the two equations (7.51). They are reported as dashed and dot-dashed lines in Fig. 7.4. 
One can conclude that, for fcr^ 7/, the adiabatic approximation holds and al^-^ — + ct/^, with 
at = 2elm WtWt/Tf and = 2elm HtHt/Tg, and the two contributions are independent. Note that 
the average dissipation due to H is much larger than the one due to w. Finally, one can write: 



(A) 



lim r-Mog(exp[-Aa'"-^]) . 



(7.56) 
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Figure 7.5: The function [Ce{p) — Ce{~p)]/'^+ for the harmonic osciUator with e = 0.5, k — 1, 
Q = Tf = 0.6, Ts = 2, jf — 1, -fs — kTs and Ts — I, 50, 250. The dashed hne is a straight hue with 
slope 1, the dotted hne has slope Tf/Tg = 0.3. 

Both z"'(A) and {\) verify the fluctuation theorem, as the two equations of motion (7.51) are 
particular instances of the general case discussed in section 7.3.2. The function Qeffijp) is the Legendre 
transform of Zef f{X) and will verify the fluctuation theorem. 

7.5.4 PDF of erf 

In the same approximation, af is given, for Q = Tf,hy 

= < + ^'^f, and ZT,(A) = z"'(A) + z«(Ar,/T/) ; (7.57) 

the contribution of Ht is weighted with the "wrong" temperature, i.e. the temperature of the fast 
degrees of freedom. Indeed, as already discussed, zq{\) does not verify the fluctuation theorem. The 
function f{p) = [Ce(p) — Ce(— p)]/c+, obtained from Eq. (7.38), is reported in Fig. 7.5. As already 
discussed in section 7.4, when the time scales of the two baths are comparable, Uts ^ 7/, the two 
baths act like a single bath at temperature G G [Tf,Ts] and the function f{p) is approximately linear 
in p with slope X e [Tf/Tg, 1]. When the time scales are well separated, fcr^ ^ "ff, the adiabatic 
approximation holds; in this situation it turns out, from the exact computation of Ce(p)i that the 
function f{p) has slope ~ 1 for small p and has slope Tf /Ts for large p (see Fig. 7.5). These results 
will be compared with numerical simulations of Lennard-Jones systems below. 



2elm 



7.6 Green-Kubo relations 

The Green-Kubo relations for transport coefficients, that are a particular form of the fluctuation- 
dissipation theorem, follow from the fluctuation relation, as discussed in section 4.4.1. In this section 
a way to link the modified fluctuation theorem - in which the external bath temperature is replaced 
by the (frequency dependent) effective temperature of the unperturbed system - to the modification 
of the fluctuation-dissipation relation will be discussed. 
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Note that even out of equilibrium one can define a flux Jt using ot as a "Lagrangian" , see Eq. (4.37) 
and [84]: 

(7.58) 



d(Jt 



Close to equilibrium at is given by Eq. (4.31) and Jt = Jt/T. If, in the absence of a drive, the system 
has a non trivial effective temperature, the entropy production rate should be defined as in Eqs. (7.33) 
and (7.42). Then the flux Jt is given by 



= 4Im / dt'T-^{t - t')atdt' = 2 f dt'T'^t - t')[ytXt' - xtyv] 

J — OO J — OO 



The fluctuation theorem for a^^^ imphes then a Green-Kubo relation for Jt: 



{J)e 



■f 

Jo 



dt {JtJo}e=o + o(e^) . 



(7.59) 



(7.60) 



The physical meaning of the latter relation becomes clear if one writes the flux Jt in the adiabatic 
approximation discussed in the previous section; from Eq. (7.54): 



Jt = 2Im 



mwt , HtHt 



Tf ^ T« 



and Eq. (7.60) becomes 



Tf 



(7.61) 



(7.62) 



Indeed, in the adiabatic approximation the Green-Kubo relation holds separately for (with tem- 
perature Tf) and for (with temperature Tg). Eq. (7.60) encodes the two contributions and holds 
even when the adiabatic approximation does not apply and the contributions of the "fast" and of the 

"slow" modes is not well separated. 

Note that the "classical" Green-Kubo relation involves the total flux Jt = J™ + . For the latter 
one has, in the adiabatic approximation. 



/■oo e r°° 

{Jt)e = {JT). + {J")e = ^ dt Jo")e=0 + dt (jf Jo^)e=0 

-t/ Jo Jo 



dt 



{JrJK)e=0 , {Jt"J^)e=0 



■f 

Jo 



(7.63) 



dt 



Teffit) 



(Jt Jo)e=0 • 



The latter relation is the generalization of the Grccn-Kubo formula that comes from the generalized 
FDR discussed in section 6.4.3. It is closely related, but not equivalent, to Eq. (7.60). 



7.6.1 The Green-Kubo relation for driven glassy systems 

Equations (7.60) and (7.63) cannot be applied straightforwardly to driven glassy systems as for these 
systems the correlation function {JtJo)e is not stationary at e = below Td- Indeed, the relaxation 
time of the latter diverges as e — > and at some point falls outside the experimentally accessible 
range: the system will not be able to reach stationarity on the experimental time scales and will start 
to age indefinitely. 

The problem is that in Eq. (7.47) the functions E(t — t') and Do{t — t'), that define the thermal 
bath, depend strongly on e through the functions C and R which are determined self-consistently. 
However, the Green-Kubo relations above have been obtained sending the driving force e — > keeping 
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the thermal bath fixed. This means that in Eq. (7.47) one should send the term eh ^ keeping fixed 
the functions S and Dq. For e 0, the main contribution to the e-dependence of the dynamics of 
a{t) comes from the e-dependence of S and Do, so removing the term eh at fixed S and Do does not 
affect too much the correlation function {JtJo)e if e is small. Thus, for small e, one can write the 
Green-Kubo relations in the form 

(Jt), ~ e r dt-^{JtJo)e , (7.64) 

Jo ^eff{t) 

even if the limit e ^ is not well defined. An analogous relation will be obtained from Eq. (7.60) 
(which is equivalent to the fluctuation theorem in the Gaussian approximation) within the same 
approximation. The latter relations can be tested in numerical simulations as well as in experiments. 



7.7 Slow periodic drive and effective temperature 

A lesson one learns from the previous calculations (see e.g. Fig. 7.4) is that the work done at large 
frequencies is overwhelmingly larger than that done at very low frequencies - precisely the one that 
one wishes to observe in order to detect effective temperatures. One way out of this is to choose a 
perturbation that does little work at high frequencies: a periodically time-dependent force that derives 
from a potential cos{ilt)V {r) , with l/Q of the order of timescale of the slow bath r^. In the following 
a one dimensional system will be discussed, the generalization is straightforward. 

Consider a single degree of freedom r moving in a time-independent potential V{r) and subject to 
a periodically time-dependent field cos{flt)V (r) , and in contact with a 'fast' and a 'slow' bath with 
friction kernel, thermal noise and temperature {p^ ,gf,Tf) and {p^,gs,Ts), respectively: 

mf(t) + y* dt' [gfit - t') +g,{t- t')]f{t') = + P^' (t) + p-'{t) - cos(m)^ , (7.65) 

The time scale of the time dependent field 1 /fl is of the same order as that of the 'slow' bath. The 
work in an interval of time (0, r) done by the time-dependent potential is: 

Wr = - cos(m') —rdt' = -V{t) + y(0) + ^ sin(Ot') V dt' . (7.66) 

Jo Jo 

Only the last term grows with the number of cycles, so for long times one can neglect the first two. 
Now, integrating (7.65) by parts, one has: 

mr{t) = -l'^dt'gf{t-t')f{t')-^^+pf + h{t)-h{t)^^ (7.67) 

h{t) = -[ dt' g,{t-t')r{t')+p'{t) . (7.68) 

where h{t) = cos{flt). In the adiabatic limit when both the timescales of the slow bath and the period 
of the potential V are large, h{t) and h{t) are quasi-static. Hence, r has a fast evolution given 
by Eq. (7.67) with h, h fixed and it reaches a distribution [139] 

-l3f(^V+hV+g,iO)4-hr) 

P{r/h, h) = -. ^ . (7.69) 

The denominator defines Z{h, h) and F{h, h) = —f3j^ log Z{h, h). Note that F{h, h{t)) is periodically 
time-dependent through h. The approximate evolution of h is now given by Eq. (7.68) with the 
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replacement of r in the friction term by its average ^^g^^^ with respect to the fast evolution: 

h{t)=j' dt'g,{t-t')^^^^{t') + p%t) . (7.70) 

Equation (7.70) is in fact a generalized Langevin equation for a system coupled to a (slow) bath of 
temperature Tg. Indeed, it can be shown [139] to be equivalent to a set of degrees of freedom 
evolving according to the ordinary Langevin equation: 



dF 



y. = m '-0^ (7-71) 



with (Ci(i)Cj (*')) = '2Ts^j6ijd{t — t'), provided that the Fourier transforms 5s(a;) an i's{u}) of friction 
kernel and noise autocorrelation can be written as: 



^2 

9s{i^) = J2 — 7 ^ 



7.4 (7-^2) 
i.,(a;) - 2T, ^ ^2(^ _ ^+)(^ _ ^-/(^ + ^+)(^ + ' 

where lu^ are the roots of —mjuy^ + i^jU + ilj = 0. 

Within the same approximation leading to (7.70), the average of V{r) over a time window A that 
is long compared to the short timescale, but sufSciently slow that one can consider that h and h are 
constant is 

V{r{t')) dt' f dr P{r/h, h) y(r) = A^^S^ (7.73) 
J dh 

so that one obtains for the work: 

Wr-^nf sin(f2i') 







dh Jo dt 



which tells that for long time intervals the work done by the original time-dependent potential V is 
indeed the same as the work done by the time-dependent effective potential F in (7.70). 

The fluctuation theorem then holds for the distribution of this work, with a single temperature 
Tjg. One concludes that the distribution of work due to a slow perturbation satisfies the fluctuation 
theorem with only the slow temperature, and can be hence used experimentally to detect it. 

The simplest application of the above general result is obtained considering V{r) = hr and V{r) = 
kr^. Then, grouping together the two noises in a single noise with friction g = Qf + Qs and correlation 
y = TfVf + TgVs as described in section 6.4.3, Eq. (7.65) becomes simply 

mr{t) + I dt'g{t - t')r{t') = -kr{t) + p{t) + /icos(Oi) . (7.75) 

This equation describes for instance the motion of a Brownian particle moving in an out of equilib- 
rium environment and trapped by an harmonic potential whose center oscillates at frequency ft. A 
concrete experimental realization of this setting has been already considered in [161]: Silica beads of 
~ 2/im diameter were dispersed in a solution of Laponite (a particular clay of ^ 3Gnm diameter) and 
water. The Laponite suspension forms a glass for large enough concentration of clay and provides the 
nonequilibrium environment. The Silica beads are Brownian particles diffusing in such environment. 
They can be trapped by optical tweezing, and the center of the trap can oscillate with respect to the 
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sample if the latter is oscillated through a piezoelectric stage. In [161] the mobility and diffusion of 
tracer particles were measured obtaining an estimate of T^f / (f2) . To check the fluctuation relation one 
has to perform a measurement of the work done by the trap on the tracers. Indeed, the work dissi- 
pated in (0, r) is linear in r{t) so it should be possible to measure it simply through the measurement 
of r(t): 

Wr = nh [ dt' sm{nt')r{t') ; (7.76) 
Jo 

note that, as Wr is linear in r{t), it is a Gaussian variable. With a simple calculation one finds 

}^oo — 2m — - = (^-^^^ 

This means that the (Gaussian) PDF of cr^^^ = Wr/Tpjf{ri) satisfies the fluctuation relation. If the 
two baths are modeled as in section 7.4 with k^s — Ts ^ '^f one has Teff{n) — Tg for Or^ < 1, see 
Eq. (7.43). The measurement of the distribution of the work (7.76) allows for the measurement of Tg. 
Note that other experimental settings described by the same equations should exist. 



7.8 Numerical simulation of a binary Lennard— Jones mixture 

It is interesting to test the predictions above in a numerical simulation of a realistic model for a 
glassy system, like the ones considered in [126, 127, 149]. The predictions obtained from the solution 
of the dynamics of p-spin models have been succesfuUy tested in the numerical simulations of these 
models. Indeed, on the space-time scales of the numerical simulations (which are very small) the glass 
transition is very similar to the mean-field one, see the discussion in section 1.4. On these scales, 
the glass transition Tg refiects the dynamical transition Td of p-spin models: the numerical results 
are very well described by mode- coupling equations of the form (6.18), see e.g. [126, 135, 136], and 
a violation of the fluctuation-dissipation theorem of the form (6.53) is observed [149]. The driven 
dynamics of these systems has been investigated in [150, 151, 166] where a uniform velocity gradient 
7 was applied on a Lennard-Joncs binary mixture, and the results described in section 6.3 were very 
well reproduced by the numerical data. 

Thus, it is interesting to see if the generalization of the fluctuation relation proposed above holds 
for these systems below Tg and for 7 ~ 0. Note that a possible generalization of the FR, of the form 

Cooip) - Coo{-p) = Xpa+ , (7.78) 

with X < 1, was proposed in [95, 112, 129] in the context of chaotic dynamical systems, see the 
discussion in section 5.7. It has also been proposed to deflne Qeff = T/X as the "temperature" 
in nonequilibrium steady states [84]. However, up to now numerical studies of the FR have been 
performed only in the high temperature region (T 3> Tg), where X = I. 

Eq. (7.78) was shown to hold approximately if the time scales of the two baths are not well separated 
in section 7.4. The numerical data that will be presented in this section [164] show that indeed (7.78) 
is satisfied by Ccx)(p) below Tg. Unfortunately, (i) it seems that the proposed connection between 
Eq. (7.78) and phase space properties is not confirmed by the numerical data, and (ii) a regime in 
which the time scales are well separated is not accessible due to limited computational power, so that 
the predictions of section 7.4 could not be completely tested. These open points will hopefully be 
addressed by future works. 



136 CHAPTER 7. EXTENSION OF THE FLUCTUATION RELATION TO DRIVEN GLASSES 

7.8.1 The model 

The investigated system is a 80:20 binary mixture of N particles in d = 3 of equal mass m interacting 
via a soft sphere potential 

V^p{r) = e^p (^^y\ (7.79) 

a,f3 E [A,B]. It is very similar to model 11^ of section 5.3, and the parameters e^p and (Tap are 
the same as in section 5.3. This system has been introduced and characterized in equilibrium by De 
Michele et al [127] as a modification of the standard LJ Kob- Andersen mixture [126] that is known to 
avoid crystallization on very long time scales, and hence to be a very good model of glass former; it 
has been chosen because the soft sphere potential can be cut at very short distance (1.50-^^) allowing 
the system to be very small^. 

A shear flow is applied to the system along the x direction with a gradient velocity field along 
the y axis. The shear flow was chosen instead of the constant force of section 5.3 for two reasons. 
On one hand, it makes easier a comparison with the existing literature concerning the driven glassy 
regime [150, 151, 166]; on the other hand, the shear flow couples directly with the cooperative struc- 
tural rearrangemens which are responsible for the glassy behavior, while the constant force used in 
section 5.3 couples to single-particle diffusion. 

The particles are confined in a cubic box with Lees-Edwards boundary conditions and the molecular 
dynamics simulation is performed using SLLOD equations of motion [80] : 

9' = m + ' 

Pi = Fiil) - IPyiX - a{p,q)pi , 

where Fi{q) = —dq.V{q) and a is a thermostat which fixed the kinetic temperature T, as discussed in 
section 5.3. The equation of motion are discretized following the procedure described in section 5.3. 
The entropy production rate^ is defined as the dissipated power W divided by the kinetic temperature 

aip,q) = ^ = -^-^^, (7.81) 

where Pxyip, q) = 'Ylfi\PxiPyi+(lyiFxi{q)] is the xy component of the stress tensor [80]. As in section 5.3, 
all the quantities are reported in units of m, caa and uaa- In these units the integration step is 
dt = 0.005. The density is fixed to p = 1.2 to compare with [126, 127, 149]. 

The main problem is in chosing the size of the system, for the following reasons: 

1. If A'' is too small, it is easy for the system to crystallize, especially in presence of shear. Thus 
one has to choose N large in order to avoid spurious fluctuations due to nucleation of crystals. 

2. On the other hand, the fluctuations of p scale as exp[— A^/(p)], so if N is too large it is impossible 
to observe negative values of p which are needed to test Eq. (7.78). 

3. One could solve this problem by choosing a very large N (~ 1000, as in [150, 151]) and looking 
to the fluctuations of cr in a small volume inside the sample, following [98, 165]. An attempt in 

^Note that for consistency with the definitions of [127] a 4 is missing. 

®The minimum size of the system is determined by the condition that the simulation box is larger than the range of 
the potential in order to avoid the interaction of a particle with its image, see e.g. [124]. The WCA potential considered 
in section 5.3 has an even shorter range: the soft sphere potential was chosen in order to make easier the comparison 
with existing results [127]. 

®Again, total derivatives will be removed from a, see section 4.4.3. 
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Figure 7.6: Viscosity as a function of temperature for different values of 7. The continuous line is a 
fit to a Vogel-Tamman-Fulcher law, r](T) = r]^ exp(^^) with -q^ = 5.2, A = 0.99, Tq = 0.85. 

this direction was made, but it turned out that it was difficult to give a good definition of local 
entropy production rate^. 

The value A^=66, which is large enough to avoid crystallization® and small enough to allow for the 
observation of negative values of p, was chosen. However, to reach the asymptotic regime one has to 
integrate a over a time interval t ^ IOtq, see the results of chapter 5. This means that for large Tq, 
i.e. for 7^0 and T < Tg, to obtain a reasonably large number of values of p, enough to observe large 
deviations, one needs to simulate Eq. (7.80) for a very large total time. This strongly limits the values 
of 7 and T which are accessible to investigation, and in particular completely rules out, for the large 
system considered here, the region where the "fast" and "slow" time scales are well separated. 

It seems that the observation of curves like the one reported in Fig. 7.5 in numerical simulations 
of glassy systems is a very difficult task. Probably some difficulties can be avoided considering e.g. 
the diffusion of a tracer particle in the sample [151], but this is a different physical situation that is 
left for future investigation. 

7.8.2 Results 

In Fig. 7.6 the viscosity rj = {Pxy)/l is reported as a function of the temperature T for different 
values of the shear rate 7. At 7 = the viscosity seems to diverge at a temperature Tq ^ 0.85; 
however, the system can be equilibrated only down to T ~ 1.1, that provides an estimate for the glass 
transition temperature Tg. For 7 > the system becomes stationary and the viscosity is finite at all 
temperatures, even below Tq. 

■^The probl em is the following: to observe the phenomenology described in section 6.3 one has to apply a shear rate 
7 ~ Ta{T)~^ [166]. If one consider a volume of linear size L, this volume will be deformed by the dynamical evolution 
due to the sliding of the different regions in the sample. The time scale of this deformation is I/7, i.e. it is the same 
time scale over which one would observe the violation of the fluctuation relation. Thus the volume looses its identity 
before any interesting effect is observed. It was not possible to find a clear way out of this contradiction, so it was 
preferred to study the global entropy production rate to avoid complications and uncontrolled effects which could alter 
the slope in Eq. (7.78), as observed e.g. in [96]. 

*The absence of Bragg peaks in the dynamic structure factor S{q) was carefully checked. 
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Figure 7.7: (Left) Top: the large deviation function Ct{p) = t^^ \ogTrr{p) as a fimction of p for 
different values of r at T = 1.4 > Tg and 7 — 0.03. Error bars are smaller than the symbols except on 
the tails: they are reported only for r = 7.5 to avoid confusion. The line is a Gaussian fit to the data 
with T > 5 for p G [0, 2]. Bottom: Ct(p) — Ct{—p) as a function of p<T+. The FR predicts the plot to be 
a straight line with slope 1 (full line) for large r. (Right) Same plots for 7 = 0.03 and T = 0.8 < Tg. 
In the lower panel the dashed line has slope 1 while the full line has slope X — 0.83. 



Very long simulation runs (up to 2 • 10^ time steps) have been performed to measure the PDF of 
the entropy production rate at different temperatures along the line 7 = 0.03. During each run, p(t), 
given by Eq. (4.21), has been measured on subsequent time intervals of duration r. From this dataset, 
the histograms of TTrip) and the large deviation function Ct(p) defined in Eq. (4.23) are obtained, 
following the procedure described in section 5.4. 

In the left upper panel of Fig. 7.7, the functions Ct(p) are reported for 7 — 0.03 and T = 1.4 > Tg. 
The asymptotic function ^00 (p) is obtained for t > 5 and can be described by a simple Gaussian form, 
Coo(p) = ^{p^ 1)^/2(5^, even if small non-Gaussian tails are observed. Note that this means that the 
finite time corrections discussed in section 5.2 are not relevant here. In the left lower panel of Fig. 7.7 
(rip) — (t{—p) is reported as a function of pcr+. The FR, Eq. (4.11), predicts the plot to be a straight 
line with slope 1 for large t; this is indeed the case for r > 5, consistently with what has been found 
in the literature and in chapter 5. 

In the right upper panel of Fig. 7.7, the functions Cr(p) f^or 7 — 0.03 and T = 0.8 < Tg are reported. 
In this case, the asymptotic regime is reached for t > 6; this value is not so different from the one 
obtained in the previous case because the change in viscosity (and hence in relaxation time) going 
from T = 1.4 to T = 0.8 is very small at this value of 7 (see Fig. 7.6). Also in this case the simple 
Gaussian form gives a good description of the data apart from the small non-Gaussian tails. In the 
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Figure 7.8: The violation factor X = T/Qeff that enters Eq. (7.78) (fuU circles) and the ratio T/T^ff 
from the generalized FDR (open diamonds) as a function of the bath temperature T for 7 — 0.03. 

right lower panel of Fig. 7.7, Cr(p) ~ Qt{~p) is reported as a function of pu-)-. At variance to what 
happens for T > Tg, in this case the asymptotic slope reached for r > 6 is smaller than 1; thus, the 
FR given by Eq. (4.11) has to be generalized according to Eq. (7.78). At this temperature, one has 
X = 0.83 ±0.05. 

In Fig. 7.8, the violation factor X{T,j = 0.03) (full circles) is reported as a function of the 
temperature T; note that X becomes smaller than unity exactly around Tg ~ 1.1, i.e. when the 
viscosity starts to diverge strongly (see Fig. 7.6). Below T 0.4, cr+ becomes so large that negative 
fluctuations of p are extremely rare and the violation factor is no longer measurable. One can conclude 
that below Tg the FR does not hold, and the data are consistent with Eq. (7.78) where the coefficient 
X is temperature dependent below Tg and equals 1 above Tg. 

Having checked the validity of Eq. (7.78), following [84] and the analysis of section 7.4, one can 
define a nonequilibrium temperature as &eff — T/X, such that defining a'^^^ [t) — W{t)/Qeff = 
Xa{t), the FR for cr"^^^ is the usual one given by Eq. (4.11). 

To compare the temperature Oeff with the effective temperature Tg// that enters the generalized 
fluctuation-dissipation relation, one can measure Tgff from the relation Tejf = D/j.i, where D is the 
diffusion constant and /i is the mobility of the particles in the considered steady state [149, 150, 151]. 
This relation generalizes the usual equilibrium FDR D — fiT; to compute the diffusion constant and 
the mobility of typc-A particles one can follow the procedure of Di Leonardo et al. [149]. In Fig. 7.8, 
together with X = T/Qeff, the ratio T/T^ff (open diamonds) is reported as a function of the bath 
temperature T . The two "effective" temperatures have a similar qualitative behavior but do not 
coincide, as found in section 7.4, and the relation T < &eff < Teff holds. 

To test the conjecture of Bonetto and Gallavotti, see [129] and section 5.7, the Lyapunov spectra 
have been computed, see section 5.5. They are reported in Fig. 7.9 for 7 — 0.03, T = 1.2 > Tg and 
T — 0.8 < Tg. Unfortunately, no qualitative change in the spectrum is observed on crossing Tg and 
in particular no pairs of negative exponents are present above and below Tg. Thus, it seems that 
the theory of [129] does not apply to the model considered here below Tg. Note however that this 
theory is developed under the assumption of a strong chaoticity of the system, while below Tg and for 
7 ~ the dynamics of the system becomes slower and slower. Thus, the results presented here should 
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Figure 7.9: Lyapunov exponents for 7 = 0.03 and T = 0.8, 1.2. For both temperatures each pair 
consists of one positive and one negative exponent. 

not be regarded as invalidating the conjecture of [129], but as indicating that the hypothesis of [129] 
(essentially, the requirement of strong chaoticity) are not fulfilled by our model below Tg. This point 
requires further investigation. 



7.9 Discussion 

An extension of the fluctuation theorem of Gallavotti and Cohen to open stochastic systems that are 
not able to equilibrate with their environments when relaxing unperturbed has been discussed. 

The simplest example at hand has been used to test several generalized fluctuation formulas: a 
Brownian particle in a confining potential coupled to non-trivial external baths with different time- 
scales and temperatures. Independently of the form of the potential energies, due to the coupling 
to the complex environment, the particle is not able to equilibrate. Its relaxational dynamics is 
characterized by an effective temperature, defined via the modification of the fiuctuation-dissipation 
relation between spontaneous and induced fluctuations. When no separation of time-scales can be 
identified in the bath, the effective temperature is a non-trivial function of the two times involved. 
Instead, when the bath evolves in different time-scales each characterized by a value of a temperature, 
the two-time dependent effective temperature is a piece-wise function that actually takes only these 
values, each one characterizing the dynamics of the particle in a regime of times. 

The fiuctuations of entropy production in a numerical simulation of a Lennard- Jones like fluid 
above and below the glass transition temperature Tg have also been studied, obtaining results that 
partially confirm the theoretical analysis. However, many points are still open and require a much 
deeper numerical investigation. 

Several authors discussed the possibility of introducing the effective temperature in the fluctuation 
theorem to extend its domain of applicability to glassy models driven by external forces [157, 159, 
158, 160]. After summarizing the results of this chapter, it will be discussed how they compare to the 
proposals and findings presented here. 
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7.9.1 Summary of results 

Different definitions of entropy production rate that arc not equivalent when the effective temperature 
is not trivially equal to the ambient temperature have been discussed. It was found that: 

1. The PDF of af = Wt/Q, where Wt is the power dissipated by the external force and is a free 
parameter with the dimensions of a temperature, does not satisfy the fluctuation theorem in 
general. 

The large deviation function, Ce{p), still shows some interesting features revealing the existence 
of an effective temperature. When the bath has, say, two components acting on different time 
scales and with different temperatures, the function [Ce(p) — C@{~P)]/<^+ may have different 
slopes corresponding to these two temperatures, one at small p and the other at large p. The 
separation of time-scales of the bath translates into a separation of scales in the function [^e {p) — 
Ce(-P)]K. 

When the time scales of the baths are not separated, and one observes the large deviation 
function for not too large values of p only, the fluctuation theorem is verified approximately if 
9 is suitably chosen. Note that the temperature Qeff defined in this way is not equal to the 
effective temperature Tg// that enters the modified fluctuation-dissipation relation in this case. 

Instead, when the time-scales are well separated, the two scales in the large deviation function 
are clearly visible and a single fitting parameter is not sufficient to make the fluctuation theorem 
hold. 

2. The PDF of af^-^ defined substituting the frequency dependent effective temperature to the con- 
stant G in the previous definition: 

^,,,^A. g K) , dt'T-\t-tf)r.it)h.m] , (7.82) 

with T~^{t) the Fourier transform of l/Te//(a;), the effective temperature of the relaxing system, 

see Eq. (6.42), always verifies the fluctuation theorem, as was shown analytically for the harmonic 
potential and numerically for the quartic one. No requirements on the characteristics of the bath 
are needed, crf'^'^ reduces to af when there is only one equilibrated bath. 

3. The additional term aY which is obtained from the Lebowitz Spohn procedure, see equa- 
tion (7.14), is not relevant for the applications discussed in this chapter, as it vanishes iden- 
tically for harmonic potentials and for any potential in the adiabatic approximation. However 
it is relevant when the potential is nonlinear and the time scales are not separated. Its detailed 
investigation is left for future work. 

4. If two time scales are present in the dynamics of a system and if the applied perturbation is 
periodic with frequency O < l/r^, Tg being the largest relaxation time, the PDF of the power 
dissipated over a (large) number of cycles verifies the fluctuation relation with temperature 
Tg = Teff{^). This is probably the easiest way of detecting the effective temperature by mean 
of the fluctuation relation. 

5. These results should apply to driven glassy systems as discussed in section 7.5. It was shown, 
in a numerical simulation of a binary Lennard-Jones mixture, that below Tg the Fluctuation 
Relation does not hold for ct®; the data -obtained in a situation where the time scales are not 
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well separated- are consistent with the statements of item 1. above. The conjecture of Bonetto 
and Gallavotti that relates the factor X in Eq. (7.78) to properties of the phase space of the 
considered system was tested; unfortunately, the data are not consistent with this conjecture, 
suggesting that the violation of the FR is, in the case studied above, of different origin than that 
proposed in [129]. This point also requires additional investigation. 

Models like the one discussed here have been recently investigated [139, 161, 162, 163] to describe 
the dynamics of Brownian particles in complex media such as glasses, granular matter, etc. Brownian 
particles are often used as probes in order to study the properties of the medium (e.g. in Dynamic 
Light Scattering or Diffusing Wave Spectroscopy experiments). Moreover, confining potentials for 
Brownian particles can be generated using laser beams [167] and experiments on the fluctuations of 
the power dissipated in such systems are currently being performed [161, 168]. 

7.9.2 Effective temperatures 

It is important to summarize the different definitions of effective temperature considered above and 
the relations between them. The effective temperature in the frequency domain is defined by equa- 
tion (6.42) as a property of the bath which can also be measured from the ratio between correlation 
and response functions in the frequency domain. As discussed above, the same effective temperature 
enters the correct definition of entropy production rate in the frequency domain, see equation (7.82). 
Thus, experiments working in the frequency domain should observe the same effective temperature 
from the fluctuation-dissipation relation and from the fluctuation relation. 

In the time domain the situation is slightly more complicated. On one hand, the effective temper- 
ature obtained from the fluctuation-dissipation relation in the time domain, defined for example by 
equation (6.50), is not the Fourier transform of Teffioj). A convolution with the correlation function 
is involved in the relation between Teff{u)) and Teff{t). On the other hand, the effective tempera- 
ture T~^{t) entering the entropy production is exactly the Fourier transform of l/Te//(a;), see again 
equation (7.82). This can give rise to ambiguities when working in the time domain. 

Most of these ambiguities disappear as long as the time scales in the problem arc well separated. In 
this case, on each time scale a well defined effective temperature can be identified, and this temperature 
enters both the fluctuation-dissipation relation and the fluctuation relation: see e.g. the curve for 
r = 250 in Fig. 7.3 and the expression of a^^^ in the adiabatic approximation, equation (7.54). This 
is essentially related to the validity of the adiabatic approximation discussed in section 7.5.1. 

The difference is relevant when the time scales of the two baths are not well separated, and a single 
effective temperature cannot be identified, sec the curve for t = 1 in Fig. 7.3. In this case, it was 
found that the fiuctuation relation holds with -approximately- a single effective temperature Qeff but 
this temperature is not clearly related to the fluctuation-dissipation temperature in the time domain. 
This was also observed in numerical simulations on Lennard-Jones systems. Still, when moving to 
the frequency domain, the two effective temperatures should coincide. 

Let us remark again that, when applying these results to real glassy systems in finite dimension, 
one should take care of the possibility that the effective temperature has large space fiuctuations due 
to the heterogeneity of the dynamics [153, 154]. The extension of the results presented here to such 
a situation is left for future work. 
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7.9.3 Comparison with previous works 

Several proposals to introduce the effective temperature into extensions of the fluctuation theorem 
appeared in the literature. 

Sellitto studied the fluctuations of entropy production in a driven lattice gas with reversible kinetic 
constraints [157]. When coupling this system to an external particle reservoir with chemical potential 
/i, a dynamic crossover from a fluid to a glassy phase is found around /i^. The glassy nonequilibrium 
phase is characterized by a violation of the fluctuation dissipation theorem in which the parametric 
relation between global integrated response and displacement yields a line with slope fieff [169]. 

One drives this (possibly already out of equilibrium) system by coupling two adjacent layers of 
the three dimensional periodic cube to particle reservoirs at different chemical potentials, /U+ and 
//,_. The former is allowed to assume values corresponding to the glassy phase, /U+ > Hd, while /x_ is 
always below /i^. The results of the Montecarlo simulation are consistent with a generalized form of 
the fluctuation theorem: 

= Jr(Me// - M-) > (7-83) 

where cr^ is the entropy production, is the particle current in the direction of the externally imposed 
chemical potential gradient averaged over a time-interval of duration r; fx^fj is an effective chemical 
potential and /x_ is the chemical potential of one of the layers. When the chemical potentials of the 
two reservoirs are in the fluid phase, /ie// = and the usual fluctuation relation holds. Instead, when 
/Lt+ is in the glassy phase, Sellitto found that Eq. (7.83) holds with /Xg// taking the value appearing 
in the violation of fluctuation-dissipation theorem in the aging regime of the undriven glassy system 
at /U+. 

The formula (7.83) differs from the ones that were found to describe the oscillator problem in 
that in the case studied here, when translating from temperature to chemical potential, the full time- 
dependent ij{t) enters. Strictly, this improved definition should also apply to the lattice gas model. 
However in the case studied by Sellitto the fast dynamics is an "intra-cage" dynamics that likely does 
not contribute to the current. This is a case in which the perturbation does not produce dissipation 
at high frequency so that the difference arising from ij,{t) ^ Heff should be tiny in this case (see 
section 7.7). 

More recently, Crisanti and Ritort [159] found that the probability distribution function of the fluc- 
tuations of heat exchanges, Q, between an aging random orthogonal model in its 'activated regime' 
(a long-time regime in which the energy-density decays as a logarithm of time) and the heat bath is 
rather well described by a stationary Gaussian part and a waiting-time dependent exponential tail to- 
wards small values of Q. Assuming that these events are of two types ('stimulated' and 'spontaneous') 
they proposed to flt the ratio between the PDF of positive and negative 'spontaneous' Q's in the form 
of a fluctuation theorem, i.e. to be proportional to e~'^^l^, and relate A to the effective temperature 
of the fluctuation-dissipation relation. They found good agreement. Crisanti, Ritort and Picco are 
currently performing simulations to test this hypothesis in Lcnnard- Jones mixtures [170]. 

Another development is an attempt to generalize the situation considered by Crooks. He considered 
a problem that starts from equilibrium in zero field and evolves according to some stochastic dynamic 
rule in the presence of an arbitrary applied field [171] and found that the ratio between the probability 
of a trajectory and its time-reversed one is given by e~^^o"""' 'iiK't)0{t) ^\\]^ /j(^) the time-dependent 
external field that couples linearly to the observable O. For simplicity, one can focus on O = 
with (j) a scalar field characterizing the system. In [158] the extension of this relation to the non- 
equilibrium 'glassy' case was conjectured. Separating the external fields h and 4> in their fast and slow 
components [172], h = hf + hg and (f) = (pf + (f)s, one then proposes that the pdfs of the trajectories 
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of the slow components satisfy a relation similar to Crooks' with the temperature replaced by the 
effective temperature (for a glassy non-equilibrium system with two correlation scales [140]). 

Finally, it is worth to mention the work of Sasa [160] where he introduces an effective temperature 
in his definition of entropy production for the Kuramoto-Sivashinsky equation. 



7.10 Appendix: Dirichlet boundary conditions for the white 
bath 

A second possibility to calculate the functional integral in Eq. (7.21) is to impose Dirichlet boundary 
conditions a(— t/2) = a{T/2) = 0. However, in this case it is possible to calculate z{X) only for m = 0. 
The distribution of at is obtained substituting p^^ = D{w)aa, in Eq. (7.25): 



V[at] = exp 
= exp 



27T 
1 

"2^ 



^ J dtat (k"^ + - 2iej^ - ) at 



dt 



(7.84) 



From Eq. (7.21) 

(exp[-ACT^]) = J^-^ J dat exp j dt at (^fc^ + - 2ze7[l - 2Axr(i)]^ - Y 

(7.85) 

where Xrit) is the characteristic function of t e [— r/2,T/2]. At the leading order in r, as the 
correlation function of at decays exponentially on a time scale tq = jk~^, one can integrate out 
the portion of the trajectory that is outside the interval [— r/2,T/2] both in the numerator and the 
denominator, to obtain 



r \ I / d d^ \ 

(exp[-Aa^]) = j dat exp J dt at i^k^ + - 2ie7(l - 2A)- - dt 



. (7.86) 



Then one has to find the eigenvalues of the operator appearing in the integral. This corresponds to 
find the solution of the equation 



at = Eat 



(7.87) 



with boundary conditions a(r/2) = a(— t/2) = 0. Note that the operator J is Hermitian, thus the 
eigenvalues are real; they are given by the following expression: 



i;„(A) = A;^+4e2A(l-A)+72 



(7.88) 



with n = 0, 1, • • • . For each n the integration is performed on one complex variable and one gets 



(exp[-Acrx]) = A/" ^ / dat exp "tt^ / dt atJa 

J 2^1 J_^,2 



n 

n=0 



En{X) 



(7.89) 



recalling that the constant J\f is simply the numerator calculated in A = 0. Finally one obtains, 
defining w = riTr/r, 



A = hm - 2^ log — — = / — log 



1 I 4e2A(l-A) 
A;2 -(- 72tj2 



(7.90) 
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The latter expression verifies obviously the fluctuation theorem. Moreover, in the m = case Eq. (7.27) 
is equal to Eq. (7.90), as one can check using suitable changes of variable in the integral. In this simple 
case, C(p) can be computed exactly. Starting from Eq. (7.90) one has 

4e2(l - 2A) 2e^{l - 2A) 



Jo TT YUJ^ 

and, recalling that z{0) = 0, 



+ fc2 + 4e2A(l - A) 7^fc2 + 4e2A(l - A) ' 



^(A) = [ d/i z'in) = [1/^2 + 4e2A(l - A) - k] . 
Jo 

The function ({p) is defined by 

C{p) = inin[ApCT+ - z(A)] = X*pa+ - z{X*) , 
where a+ = 2e^ /['yk) and A* is defined by z'{\*) = P<t+; hence. 



p = 



k{l-2X*) 



Vfc2+4e2A*(l- A*) 



1-P\ 



I e2 + fc2 

e2p2 -)- fc2 



and finally 



e'^p 



i-p\ 



e2 + fc2 
e2p2 + fc2 



' e2 + fc2 
e2p2 + fc2 



From the latter expression it is easy to verify that 



c(p) - a-p) = 



2fp 

k 



= pa+ 



(7.91) 



(7.92) 



(7.93) 



(7.94) 



(7.95) 



(7.96) 



as stated by the FT. Defining rg = 7/fc, the relaxation time of the correlation function of Oj, and 
(To = a+To/2 = e2/fc2, the (adimensional) entropy production over a time to/2, one obtains 



Cip) 



l+pcro- ^/(l + ao)(l+p2ao) 



(7.97) 



7.11 Appendix: Fluctuation theorem for many equilibrium 
baths at different temperature 

Here the function z{X) will be computed in the case in which the driven oscillator is coupled to 
N colored baths with generic memory functions and in equilibrium at different temperatures. The 
violation of the fluctuation-dissipation theorem for the relaxing particle in such an environment was 
discussed in section 6.4.3. As discussed there, the equations are mathematically equivalent to the ones 
discussed in section 7.3.2; thus the strategy as well as many details of the calculation are the same as 
in sections 7.3.1 and 7.3.2. 

The equations of motion are 



/oo 
ds gi{t — s)ds 
-00 



—00 

with K = k — ie. The thermal noises satisfy 

(PttPjo) = (PttPjo) = , 
{PitPjo) = 5ijTiVi{t) . 



N 

^Pit 
i=l 



(7.98) 



(7.99) 
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By causality, the functions gi{t) must vanish for t < 0. As the baths are in equiUbrium at temperature 
Tj, the functions fc'j(f) and gi{t) are related by Eq. (6.43): 



i^iit) = Ti[gi{t) + Qii-t)] = Tigi{\t\) , 
Tigi{t) = 6{t)vi{t) . 

In the frequency domain Eq. (7.98) becomes 

X^j Piuj _ X^j Pu 



—muj'^ + K — i(j'^^gi{uj) D{uj) 

where D{u)) = —muP' + k — icu gi{uj). 
The dissipated power is given by 



(7.100) 



(7.101) 



dH 
~dt 



/OO 
ds gi{t - s)dths + 2Re ^ dtPu = W( - ^ , (7.102) 
.. -OO 



where as in the previous cases Wj = 2elmdtat is the' powcT injc'ctcd by the external force and Wu 

citZs — 2Redtpit is the power extracted by the i-th bath. 



The first definition of entropy production rate, Eq. (7.34), gives (in the following 
°oolv ^ the error is 0(1) for r ^ oo, see section 7.3.1): 

div 2eu}\au,\'^ 



27r 2-^n=—QO 



Substituting = pi^^/ D{u), one obtains 



2-K e 



dpi^ exp - j —Y2pi^A^j{oj)pju 



where (w) is a, N x N real matrix which elements are given by 



A 2ew 



Tm{w) \D{u)\^ e ■ 



Then, 



/\\ V -ii TT det^-^(w„) doj 
.e(A)=^lnnr log [] = 



det A^{uj) 



detA°{oj) 



The determinant of a matrix of the form A^j — Cj ^^ij + \b satisfies the relation 



det A^ 
det^io 



= l + A&^c, ; 



one finally obtains 



2e(A) = / ^ log 



(7.103) 



(7.104) 



(7.105) 



(7.106) 



(7.107) 



(7.108) 



In general, it does not exist a choice ofQ such that z@{X) verifies the fluctuation theorem, i.e. z@{X) ^ 

^e(l- A). 

For the second definition, given by Eq. (7.33), the computation is identical to the one of the 
previous section with the substitution © — > Te//(u;), where Te//(w) is given by Eq. (6.49). The result 
is then 



i-oo 2^ 



log 1 



T,ff{w)\D{uj)[^ 



i-oo 2^ 



log 



(7.109) 
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Observing that 



D{-Lo) = D{uj) - 2ie , 

\D{-u;)\' = \D{u;)\'-2eoJJ2''^i^) > 



(7.110) 



and using the same trick already used in section 7.3.1, it is easy to show that Zeff{X) = Zeff{l — A). 



7.12 Appendix: Entropy production of the thermal baths 

A different definition of entropy production rate based on the power extracted by the thermal bath 
instead of the one injected by the driving force will be discussed in this section. The two differ by a 
total derivative if there is only one bath, see Eq. (7.18), so their asymptotic distributions should be 
identical at least for \p\ < 1, see [120] and section 4.4.3. 

If there are many baths equilibrated at different temperature, the study of the entropy production 
extracted by each bath allows to separate the different contributions to the total entropy production 
weighting each one with the right temperature, i.e. one can define the entropy production rate of the 
baths as 



N 



-hatht 



= E 



Ti 



(7.111) 



This quantity takes into account heat exchanges between the baths, and its average value does not 
vanish at e = 0, as will be shown in the following. 
To compute 2;(,otfts(A), one rewrites Eq. (7.111) as: 



r/2 

/ 

-r^ 27r 



VjJ 



lOJ 



D{u)Tj D{oj)Ti 



Defining the functions 



p(a;) = iujD{uj) , 

2 t'i(w) 



F{uj) 



(7.112) 



(7.113) 



one obtains 



//•OO 7 
dpi^ exp - j -^^p,^4(a;)p 



where A^(a;) is a, N x N matrix which elements are given by 



Si, 



A 



Then, 



ZbathsW = hm r ^ log IT 



det A^{uJn) 
det A°{u>n) 



-Lj -Li 



du) , 
2^ 



det A^{lo) 
det AO{oj) 



(7.114) 



(7.115) 



(7.116) 
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The matrix A has the following form: 

^cr'^ + iibi, 

where /x = X/\D{u))\'^, Ci = TiViiuj) and bij = 
polynomial in ji of the following form: 



Ubij ^ 
'^ + HbjjJ 



(7.117) 



F{u!) + + Its determinant is an order A'' 



Ti 



detA^ 
detAO 



i<j<k 



bji bjj 



bik 
bjk 



bki bkj bkk 



+ ■■■ 



(7.118) 



To compute the coefficients explicitly, define first by T-^-^ = ^ — Tj ^. The coefficient of is 
given by a sum of determinants of the form 



^ Ti Ti Ti 

^ ^ T\ ^ Tj Tj 



Ti ^ Tji 

F + P_ + P. ^ 

Ti Tji 



^ 



+ T. + Ti 



P 

Ta 



\P\' 



(Tij) 



2 ' 



(7.119) 



where the first column was first subtracted from the second column, and then the second row was 
subtracted from the first row. All the coefficients of the higher powers of A vanish. Consider for 
example the coefficient of A^. It has the form 



F + 


T, ^ 


V ^ 

T. 


F4 


i _|_ ^ 

Ti ^ Tj 


F 


+ p. + ^ 

^ T, ^ Tk 






F + 


p 


h ^ 

T, 


F4 




P 

T, 


F 


^ T, ^ Tk 






F + 


p 

Tfc 


^ Ti 


F + 




P 

^3 


F 


4- JL + P. 

^ Tk ^ Tk 






F + 


T, ^ 


h ^ 
Ti 


p 

T^i 


P 
Tki 






P 
Tik 








F + 


P 
T- 


h ^ 

T, 


P 

T,, 


P 

Tki 






P 

Tjk 








F + 


p 

Tk 


T, 


P 

T,, 


P 
Tki 




F + 


P I P 
Tk ^ Ti 


p 

T,, 


p 

Tk, 



(7.120) 



, 



subtracting the first column to the second and third column, and then the third row to the first and 
second row. The same argument applies to all the other coefficients up to order A''. Finally, one gets 



det A^{oj) 
detAO(a;) 



= 1 + 



A 



2eujXJ2it'i{^) , A(l-A) 



X^\p{to)\^Y^T,Tjiy,{uj)iyj{uj) 

i<j 



\D{uj) 



+ 



E 



T,TjVi{uj)uj{uj) 



and 



ZbathsW = I ^log 



^ 2euXj:^M^) ^ A(l-A) ^ 



TiTjVi{Lo)vj{uj) 



(7.121) 



(7.122) 



The first term in the logarithm is proportional to e and is related to the power injected by the external 
force, while the second term accounts for heat exchanges between the baths and does not vanish at 
e = 0. Finally, observing that 



D{-uj) = D{uj) - 2ie , 

\D{-u;)f = \D{u)f-2eujY,M<^) , 



(7.123) 
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and using the same trick already used in section 7.3.1, it is easy to show that ZbathsW = Zbathsi^ — A). 

Thus Cbathsip) should verify the fluctuation relation at least for \p\ < 1, if the contribution of boundary 
terms is not negligible. This result is of interest for the study of heat conduction and is similar to the 
one discussed in [84]. 



7.13 Appendix: Fluctuation relation for the spherical ]9-spin 
model 

It has been shown in section 7.5 that the dynamics of the mean field spherical model is described by 
the following equation: 

/.oo 

&it) = -fia{t) + / dt' S(t - t')ait') + p{t) + eh{t) , 



{p{t)p{t')) = 2T6{t - t') + Do{t - t') , (^-^2^^ 
{h{t)h{t')) =D^{t-t') , 

where p{t) and h{t) arc two uncorrolatod Gaussian variables, and S, Dq represent a nonequilibrium 
bath once the self-consistency equations for R and C are solved. The term eh{t) represent the external 
drive. 

This equation is a particular instance of the general equation 

/oo 
dt' g{t - t')x{t') = -kx{t) + p{t) + eh{t) , 
-CSO 

{p{t)p{t')) = v{t-t'), C^-^^^) 
{h{t)h{t')) = ii{t - t') , 

with m = 0, = 2T+Do{uj) and g{uj) = l-|-S(a;)/(za;). This gives, in absence of drive, an effective 
temperature 

"^^^ ' 2Re giuj) 2Rc [1 + S(cj)/(«cj)] ' ^ ' ' 

If R and C arc related by the FDR, R{t) = -(3e{t)C{t), from the relation S = RD'q{C) follows that 
T,{t) = -f39{t)Do{t), i.e. Do{uj) = 2rRe [i;(u;)/(ia;)], see section 6.4.1, so Te//(w) = T and the bath 
is in equilibrium, as expected. If R and C do not veriiy the FDR, T^f f ^T. 

The dissipated power is W{t) = eh{t)x{t), and its average is {W{t)) = e{h{t)x{t)). The linear 
equation (7.125) is solved by 

/oo 
dt' R{t - t!)[p{t') + eh{t!)\ , (7.127) 
-oo 

so that 

{W{t)) = e {h{t)x{t)) = e /h{t) f dt' R{t - t') [p{t!) + eh{t')\ ) = / dt! R{t - t')p.{t - t') , 

\ J —OO I J —OO 

(7.128) 

which gives Eq. (7.48). 

Finally, it is possible to prove that the PDF of 



{t)=t \ dt' T-\t - t') [h{t)x{t') + h{t')x{t)\ (7.129) 
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verifies the fluctuation relation. Following the strategy of section 7.3.1 and 7.3.2 one flrst rewrites 

(7.130) 



eff _ ^ \ ^ hnWnXn 



27r ^ TeffiuJn) ' 
n= — oo J J ^ ^ 

and then, using x(oj) = [p(oj) + eh{ijj)]/ D{uj), with -D(w) = — mw^ — iujg{uj) + k, computes^ 



exp 



n 



1 + 2e^A 



2. /x(w)w2Re5(w) 



2i/(w„) 2^(a;„) Te//(u;„)L»(w„) 

1 

/i(u;)z^(u;)u;^ 



so that, substituting Eq. (7.126), 



[Te//(u;)]2|D(o 



(7.131) 



^e//(A) 



duj 
2^ 



log 



l + 4e2A(l- A) 



/i(^'j^-[Rcy(^')]^ 



(7.132) 



which clearly verifles Zeff{X) = Zeffi^ — X)- 



7.14 Appendix: Correlation functions of the harmonic oscil- 
lator coupled to two baths 

In the harmonic case, V(|ap) = ||ap, the correlation function of a variable flf, whose time evolution 
is given by Eq. (7.40), can be computed analytically [139]. In the frequency domain, Eq. (7.40) reads: 

pL + pI ^ pL + Pt 



K — ILO'^f — Y 



(7.133) 



where D{uj) = n-iuj^f-^^^. Recalling that = A-K^fTf5{uj+uj') and = ^^5{uj+ 

co'), and defining C{u}) from {a^a'J) = 27r6{co +co')C{u) one gets 



dpi D{io) ' 
27/T; - 



(7.134) 



\D{u:) 



The function (1 — lots)D{(jj) is a polynomial in (jj and its zeros are given by a; = —i^± where 

1 



7± 



27/rs 



(kTs + 7/ + 7s) ± \J (kts + 7/ + 7s)^ - 4:KTs^f 



and Re 7± > 0. The response function is then given by 

9{t) 



, 27r £>(a;) 7/Ts 
and the correlation function is given by 



7- - 7+ 



7+ -7- 



Cit) 



1 



(7/Ts)^ 



(7- -7+) (7- +7+)Re7+ 



(7+ -7-) (7+ +7-)R-e7- 



(7.135) 



(7.136) 



(7.137) 



^Some factors are different because now all the quajitities are real numbers instead of complex numbers. 



7.15. APPENDIX: THE EXPRESSION OF cr^^^ IN THE ADIABATIC APPROXIMATION 
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In the case e = 0, and in the limit 7/ <C 7s <C kTg where the time scales of the two baths are well 
separated, one obtains 

kTs + 7s 

7+ 



Ts V 7s + kTg 

and 



^ (7-138) 



[KTs + 7s) fc^s + 7f 

^ - / , (7.139) 

_(A:rs+7s)"' 7/ 



i?(t) = 6'(t) 



From the latter expressions it is easy to check that one has R{t) ~ —(3fO{t)C{t) for short times [t <C t,) 
and R{t) ^ —Ps6{t)C{t) for large times {t ^ r,). The same behavior is foimd in the limit of small 
dissipation (small e), as one can check plotting the exact expression for the functions R{t) and C{t). 

7.15 Appendix: The expression of a^^^ in the adiabatic ap- 
proximation 

Starting from the expression (7.42) for cf^^^ and from Eq. (7.44), and remembering the convention 
ds 5{t -s) = e{0) = 1/2, one has: 

T*{t-t') 2Tf 20T/7/(ts)H TfJJ_^ ^ ' 

One can substitute at = Ht + wt and neglect all the terms proportional to HtWt: indeed, such terms 
vanish when a^^-^ is integrated over time intervals of the order of Tg, as, on such time scales, (wt) = 
while H is constant. The first term gives then 

2Tf 2Tf ' K ■ ) 

In the second term, as f2 1/ts, one approximates dt' e~^(*~* ^df ^ Ht/Sl to obtain 

(1 - r^^U-TA UtHt . (7.142) 



2n2T/7/(rs)2 V TfJ ' ' 2Ts\ Tf 
The (imaginary part of the) sum of these two terms times 4e gives Eq. (7.54). 
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